-- Logs begin at Wed 2022-06-29 09:13:28 UTC, end at Wed 2022-06-29 10:48:09 UTC. -- Jun 29 09:49:39.292323 dv-cinder-768105-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 09:49:39.308063 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 09:49:39 2022] *** Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: nodename: dv-cinder-768105-16-iscsi Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: machine: x86_64 Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: clock source: unix Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: pcre jit disabled Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: detected number of CPU cores: 4 Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: current working directory: / Jun 29 09:49:39.311258 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: detected binary path: /usr/bin/uwsgi-core Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: your processes number limit is 47680 Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: your memory page size is 4096 bytes Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: detected max file descriptor number: 2048 Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: lock engine: pthread robust mutexes Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: thunder lock: enabled Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 09:49:39.312281 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 09:49:39.386425 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: Python main interpreter initialized at 0x55624ab379c0 Jun 29 09:49:39.386425 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: python threads support enabled Jun 29 09:49:39.386425 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: your server socket listen backlog is limited to 100 connections Jun 29 09:49:39.386425 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: your mercy for graceful operations on workers is 90 seconds Jun 29 09:49:39.386994 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 09:49:39.387178 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: *** Operational MODE: preforking *** Jun 29 09:49:39.387659 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: *** uWSGI is running in multiple interpreter mode *** Jun 29 09:49:39.387659 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: spawned uWSGI master process (pid: 103185) Jun 29 09:49:39.387964 dv-cinder-768105-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 09:49:39.389455 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: spawned uWSGI worker 1 (pid: 103186, cores: 1) Jun 29 09:49:39.389455 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: spawned uWSGI worker 2 (pid: 103187, cores: 1) Jun 29 09:49:39.390014 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 09:49:40.053976 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 09:49:40.490440 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 09:49:41.208229 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:49:41.208229 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: from cryptography.utils import int_from_bytes Jun 29 09:49:41.208998 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:49:41.208998 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: from cryptography.utils import int_from_bytes Jun 29 09:49:41.594845 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:49:41.594845 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: from cryptography.utils import int_from_bytes Jun 29 09:49:41.595872 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:49:41.595872 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: from cryptography.utils import int_from_bytes Jun 29 09:49:43.745868 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 09:49:43.746756 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 09:49:43.746756 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 09:49:43.747060 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 09:49:43.747345 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 09:49:43.747754 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.748059 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.748463 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.748757 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.749089 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.749399 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.749720 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.750035 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.750551 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.750754 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.750945 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.751268 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-16-iscsi {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.751590 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.751895 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.752203 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.752524 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.752832 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.753150 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.753452 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.753952 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.754404 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.754737 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.755046 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.755385 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.755698 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.756003 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.756324 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.756625 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.756951 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.757260 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.757681 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-16-iscsi {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.757993 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.758311 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.758640 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.759089 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.759391 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.759675 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.759997 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.760339 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.760653 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.760969 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.761268 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.761586 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.761904 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.762206 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.762511 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.762912 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.763375 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.764246 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.764246 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.764246 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.764670 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.764670 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.764975 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.765299 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.765549 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.765801 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.766120 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.766439 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.766772 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.767080 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.767385 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.767689 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.767997 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.768301 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.768606 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.768914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.769235 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.769548 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.769870 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.770175 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.770492 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.770918 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.771166 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.771473 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.771810 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.772125 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.772429 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.772750 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.773069 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.773374 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.773681 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.773981 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.774297 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.774650 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.774954 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.775199 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.775497 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.775799 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.776115 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.776417 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.776721 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.777026 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.777323 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.777627 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.777931 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.778236 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.778611 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.778929 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.779233 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.779538 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.779842 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.780143 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.780463 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.780780 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.781086 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.781388 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.781691 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.781995 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.782312 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.782635 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.782944 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.783267 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.783572 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.783874 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.784190 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.784494 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.784797 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.785112 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.785411 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.785715 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.786032 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.786337 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.786658 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.786963 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.787265 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.787566 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.787866 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.788166 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.788470 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.788767 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.789082 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.789402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.789709 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.790122 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.790349 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.790642 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:43.790981 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.791309 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.791651 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.791965 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.792297 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.792628 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.792944 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.793257 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.793568 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.793893 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.794265 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.794641 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.794911 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.795231 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.795548 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.795877 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.796198 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.796515 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.796833 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.797142 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.797460 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.797786 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.798110 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.798421 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.798790 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.799137 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.799451 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.799781 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.800107 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.800527 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.800749 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.801013 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.801340 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.801672 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.801985 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.802304 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.802645 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.802960 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.803272 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.803584 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.803889 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.804240 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.804559 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.804873 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.805186 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.805501 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.805814 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.806128 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.806438 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.806781 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.807086 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.807389 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.807740 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.808011 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.808339 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.808674 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.808980 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.809317 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.810109 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.810109 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.810732 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.810977 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.811328 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.811650 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.811966 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.812274 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.812615 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.812933 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.813241 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.813567 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.813875 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.814178 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.814497 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.814841 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.815151 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.815461 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.815772 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.816101 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.816415 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.816729 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.817078 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.817405 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.817709 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.818035 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.818359 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.818701 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.819007 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.819317 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.819619 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.819924 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.820227 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.820532 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.820832 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.821138 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.821440 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.821742 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.822046 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.822376 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.822714 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.823018 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.823320 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.823623 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.823967 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.824268 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.824615 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.824952 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.825299 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.825647 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.825958 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.826487 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.826675 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.826909 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.827219 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.827528 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.827851 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.828159 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.828478 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.828786 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.829113 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.829424 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.829742 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.830045 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.830358 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.830727 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.831065 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.831381 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.831703 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.832013 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.832334 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.832642 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.833073 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.833389 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.833697 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.834016 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.834326 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.834666 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.834977 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.835303 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.835612 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.835930 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.836233 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.836545 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.836876 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.837206 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.837511 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.837824 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.838141 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.838448 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.838785 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.839093 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.839395 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.839697 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.840003 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.840320 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.840619 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.840991 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.841429 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.842290 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.842290 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.842290 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.842780 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.842780 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.843119 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.843430 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.843752 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.844080 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.844383 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.844684 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.845008 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.845340 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.845974 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.846277 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.846622 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.846961 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.847270 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.847573 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.847887 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.848209 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.848515 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.848827 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.849133 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.849440 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.849760 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.850072 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.850382 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.850714 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.851026 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.851333 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.851640 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.852177 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.852368 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.852572 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.852865 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.853167 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.853475 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.853863 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.854460 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.854820 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.855140 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.855463 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.855784 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.856102 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.856446 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.856826 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.857176 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.857484 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.857796 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.858104 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.858408 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.858749 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.859057 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.859362 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.859664 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.859976 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.860278 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.860582 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.860885 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.861190 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.861503 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.861804 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.862377 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.862377 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.862757 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.863065 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.863369 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.863669 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.863972 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.864314 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.864614 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.864955 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.865285 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.865626 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.865930 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.866233 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.866556 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.866878 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.867181 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.867483 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.867792 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.868099 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.868398 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.868707 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.869014 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.869319 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.869625 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.869925 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.870231 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.870531 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.870879 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.871183 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.871484 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.871783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.872109 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.872594 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.872753 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.873021 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.873618 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.873839 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.874143 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.874447 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.874775 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.875085 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.875394 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.875695 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.876023 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.876335 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.876639 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.876941 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.877247 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.877550 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.877851 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.878157 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.878478 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.878820 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.879123 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.879430 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.879732 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.880037 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.880336 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.880638 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.880938 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.881238 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.881539 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.881839 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.882141 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.882461 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.882909 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.883077 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.883367 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.883677 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.884018 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.884317 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.884675 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.884978 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.885286 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.885604 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.885913 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.886219 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.886528 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.886851 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.887168 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.887471 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.888359 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.889165 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.889165 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.889441 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.889689 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.890004 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.890328 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.890679 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.891009 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.891316 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.891625 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.891936 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.892245 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.892554 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.892888 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.893171 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.893487 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.893799 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.894111 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.894423 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.894755 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.895068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.895378 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.895682 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.896008 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.896317 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.896620 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.896930 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.897232 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.897542 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.897847 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.898284 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.898616 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.898932 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.899237 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.899548 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.899861 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.900176 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.900488 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.900787 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.901204 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.901515 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.901823 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.902133 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.902434 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.902761 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.903182 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.903437 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.903747 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.904090 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.904352 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.904771 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.905080 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.905402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.905824 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.906137 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.906441 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.906883 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.907195 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.907505 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.907887 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.908141 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.908465 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.908768 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.909083 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.909393 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.909717 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.910041 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.910352 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.910688 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.910994 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.911319 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.911639 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.911953 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.912274 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.912689 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.913013 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.913457 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.913649 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.913970 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.914277 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.914591 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.914911 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.915215 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.915520 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.915841 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.916145 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.916458 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.916767 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.917080 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.917382 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.917684 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.918004 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.918305 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.918679 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.919075 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.919604 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.919604 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.919604 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.920605 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.920848 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.921152 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.921457 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.921763 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.922109 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.922415 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.922770 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.923108 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.923442 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.923754 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.924093 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.924423 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.924738 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.925054 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.925377 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.925681 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.925984 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.926294 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.926639 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.926909 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.927211 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.927518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.927824 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.928133 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.928433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.928757 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.929059 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.929380 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.929686 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.929991 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.930293 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.930607 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.930957 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.931257 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.931589 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.931904 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.932225 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.932551 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.932857 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.933182 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.933495 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.933921 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.934246 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.934592 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.934929 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.935301 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.936102 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.936102 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.936392 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.936583 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.936902 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.937473 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.937800 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.938113 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.938425 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.938765 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.939078 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.939389 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.939697 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.940010 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.940318 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.940626 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.940957 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.941281 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.941607 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.941947 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.942267 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.942631 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.942912 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.943231 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.943588 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.943901 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.944263 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.944504 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.944819 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.945130 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.945439 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.945751 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.946062 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.946372 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.946702 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.947010 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.947319 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.947632 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.947957 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.948288 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.948609 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.948922 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.949233 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.949546 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.950106 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.950727 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.951716 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.951716 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.951997 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.952142 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.952381 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.952712 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.953028 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.953334 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.953647 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.953960 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.954267 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.954609 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.954926 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.955232 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.955551 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.955859 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.956417 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.956772 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.957088 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.957415 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.957741 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.958059 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.958364 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.958713 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.959021 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.959327 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.959643 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.959952 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.960257 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.960559 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.960868 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.961179 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.961481 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.961789 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.962092 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.962416 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.962745 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.963052 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.963355 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.963666 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.963968 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.964276 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.964579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.964879 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.965190 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.965499 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.965797 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.966128 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.967212 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.967212 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.967212 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.967612 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.967796 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.967985 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.968290 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.968608 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.968915 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.969233 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.969542 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.969853 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.970199 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.970880 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.971445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.971776 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.972095 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.972432 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.972764 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.973071 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.973375 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.973678 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.974000 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.974309 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.974671 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.974945 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.975256 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.975563 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.975873 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.976180 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.976489 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.976794 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.977101 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.977408 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.977714 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.978019 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.978335 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.978707 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.979031 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.979351 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.979669 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.979984 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.980293 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.980603 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.980913 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.981222 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.981593 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.981929 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.982905 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.982905 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.983202 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.983354 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.983594 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.983915 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.984224 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.984545 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.984863 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.985174 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.985496 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.985805 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.986133 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.986473 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.986825 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.987150 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.987456 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.992117 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.993402 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.994593 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.994593 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.994593 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.994593 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.994593 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.995498 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.995498 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.996903 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.996903 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.996903 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.996903 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.998165 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.998165 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.998165 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.998684 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 09:49:43.998684 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 09:49:43.999475 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.999475 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:43.999899 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 09:49:44.000070 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.000224 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 09:49:44.000224 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 09:49:44.000509 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.000660 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.000806 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.000806 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.001091 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.001237 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.001237 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.001488 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.001616 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.001782 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.001928 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.002072 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.002255 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.002551 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.002786 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.003069 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.003233 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.003550 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.003706 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.003953 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.004117 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.004264 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.004491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.004645 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.005025 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.005190 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.005320 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.005527 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.005678 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-16-iscsi {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.005876 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.006079 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.006245 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.006460 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.006652 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.006817 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.007103 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.007256 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.007415 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.007634 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.007787 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.008140 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.008305 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.008465 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.008647 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.008797 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.008984 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.009218 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.009371 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.009603 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.009932 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.010083 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.010282 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.010509 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.010704 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.010960 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.011111 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.011270 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.011545 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.011699 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.011907 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.012130 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.012283 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.012437 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 09:49:44.012663 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.013150 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.013581 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.013997 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.014426 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.014969 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.015559 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-16-iscsi {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.015988 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.016399 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.016811 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.017445 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.017856 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.018269 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.018751 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.019172 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.019575 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.020018 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.020447 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.020865 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.021287 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.021701 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.022140 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.022553 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.023035 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.023446 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.023848 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.024198 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.024605 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.025023 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.025526 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.025957 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.026328 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.026725 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.027148 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.027588 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.028001 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.028560 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.028940 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.029349 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.029756 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.030170 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.030610 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.031019 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.031441 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.031854 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.032270 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.032690 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.033110 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.033621 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.033967 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.034372 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.034864 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.035284 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.035768 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.036191 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.036629 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.037040 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.037452 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.037856 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.038272 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.038736 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.039228 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.039600 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.040026 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.040458 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.040899 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.041330 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.041756 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.042182 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.042651 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.043169 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.043702 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.044319 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.044850 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.045400 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.046047 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.046551 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.047081 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.047632 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.048133 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.048512 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.048877 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.049315 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.049750 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.050165 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.050614 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.051026 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.051430 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.051846 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.052246 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.052641 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.053059 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.053568 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.054118 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.054740 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.055268 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.055813 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.056370 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.056935 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.057966 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.057966 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.057966 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.058373 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.058947 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.059330 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.059772 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.060150 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.060548 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.060940 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.061324 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.061700 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.062076 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.062467 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:49:44.062913 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.063316 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.063730 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.064116 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.064520 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.064923 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.065311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.065693 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.066079 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.066536 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.066972 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.067411 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.067857 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.068383 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.068825 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.069279 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.069715 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.070152 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.070637 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.071055 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.071477 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.071911 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.072328 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.072734 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.073188 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.073633 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.074042 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.074463 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.074943 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.075401 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.075822 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.076231 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.076720 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.077160 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.077570 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.077988 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.078446 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.078882 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.079241 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.079627 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.080007 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.080428 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.080814 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.081195 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.081578 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.081961 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.082339 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.082766 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.083147 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.083524 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.083908 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.084284 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.084664 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.085041 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.085430 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.085829 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.086200 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.086636 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.087121 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.087541 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.087924 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.088302 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.088751 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.089156 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.089539 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.089915 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.090319 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.090744 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.091261 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.091663 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.092039 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.092412 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.092798 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.093177 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.093557 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.093936 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.094327 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.094772 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.095153 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.095893 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.096301 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.096703 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.097076 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.097585 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.098044 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.098476 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.098948 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.099353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.099754 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.100164 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.100581 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.100990 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.101394 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.101795 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.102194 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.102677 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.103007 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.103389 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.103742 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.104096 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.104447 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.104799 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.105195 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.105547 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.105942 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.106329 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.106766 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.107140 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.107594 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.108037 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.108509 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.108918 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.109349 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.109767 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.110193 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.110645 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.111066 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.111506 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.111938 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.112351 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.112768 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.113169 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.113581 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.114021 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.114457 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.114915 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.115335 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.115751 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.116160 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.116572 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.117034 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.117448 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.117968 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.118363 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.118815 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.119231 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.119646 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.120076 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.120488 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.120907 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.121313 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.121723 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.122269 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.122734 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.123141 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.123754 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.124173 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.124586 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.124988 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.125404 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.125803 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.126200 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.126651 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.127083 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.127499 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.127905 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.128398 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.128808 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.129216 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.129645 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.130043 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.130458 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.130919 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.131330 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.131748 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.132176 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.132584 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.132982 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.133407 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.133816 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.134217 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.134675 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.135088 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.135545 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.135951 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.136351 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.136773 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.137195 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.137599 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.138057 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.138550 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.139022 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.139460 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.139893 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.140299 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.140712 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.141120 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.141526 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.141943 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.142375 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.142829 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.143244 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.143650 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.144048 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.144464 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.144876 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.145564 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.146001 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.146411 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.146868 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.147281 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.147718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.148148 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.148653 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.149092 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.149509 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.149919 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.150317 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.150770 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.151174 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.151576 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.151975 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.152410 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.152823 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.153220 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.153761 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.154171 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.154596 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.155000 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.155375 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.155756 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.156132 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.156533 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.156912 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.157358 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.157735 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.158109 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.158544 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.159049 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.159474 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.159876 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.160357 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.160797 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.161230 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.161679 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.162129 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.162627 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.163021 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.163429 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.163836 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.164238 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.164662 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.165077 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.165495 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.165898 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.166303 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.166761 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.167175 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.167633 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.168044 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.168443 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.169042 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.169370 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.169753 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.170131 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.170300 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Registered counter for database nova_api Jun 29 09:49:44.170660 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.171068 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.171542 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.171953 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.172354 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.172754 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.173167 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.173573 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.173983 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.174411 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.174940 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.175343 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.175751 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.176160 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.176581 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.176981 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.177400 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.177923 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.178325 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.178753 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.179207 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.179605 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.179984 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.180361 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.180753 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.181129 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.181505 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.181877 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.182252 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.182673 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.183079 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.183466 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.183841 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.184215 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.184589 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.185079 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.185451 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.186837 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.186837 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.187026 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.187522 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.187949 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.188431 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.188850 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.189348 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.189786 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.190211 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.190732 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.191096 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.191560 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.192045 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.192501 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.192903 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.193321 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.193717 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.194110 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.194258 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.194550 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.194977 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.195437 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.195822 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.196201 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.196592 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.196976 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.197411 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.197889 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.198412 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.198930 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.199458 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.199984 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.200524 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.201021 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.201528 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.202034 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.202538 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.203077 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.203575 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.204077 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.204238 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.204576 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.205304 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.205825 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.206325 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.206867 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.207369 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.207876 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.208400 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.208939 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.209455 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.210190 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.210749 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.211259 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.211773 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.212286 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.212799 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.213323 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.213882 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.214401 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.214947 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.215439 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.216105 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.216678 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.217219 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.217945 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.218472 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.219031 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.219736 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.220255 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.221136 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.221682 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.222221 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.222794 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.223295 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.223814 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.224330 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.224877 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.225427 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.225969 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.226499 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.227041 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.227583 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.228139 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.228664 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.229219 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.229926 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.230466 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.231038 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.231621 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.232171 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.232930 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.233449 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.233957 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.234473 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.235037 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.235595 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.236115 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.236634 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.237157 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.237687 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.238242 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.238779 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.239327 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.239835 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.240367 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.240892 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.241443 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.241978 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.242498 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.243100 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.243615 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.244136 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.244658 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.245174 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.245752 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.246266 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.246830 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.248225 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.248710 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.249246 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.249813 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.250364 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.250943 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.251478 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.252024 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.252539 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.253054 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.253577 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.254085 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.254642 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.255150 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.255673 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.256187 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.256692 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.257204 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.257764 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.258271 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.258836 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.259375 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.259891 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.260415 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.260926 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.261530 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.262047 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.262664 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.263219 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.263747 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.264325 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.264842 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.265392 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.265924 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.266456 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.267035 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.267563 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.268102 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.268639 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.269172 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.269698 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.270227 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.270884 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.271425 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.272385 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.272920 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.273437 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.273953 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.274473 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.275045 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.275577 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.276093 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.276606 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.277128 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.277647 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.278196 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.278895 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.279470 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.280053 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.280596 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.281108 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.281639 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.282168 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.282812 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.283340 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.283861 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.284389 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.284925 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.285455 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.285980 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.286502 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.287063 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.287593 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.288127 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.288635 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.289148 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.289678 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.290226 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.290819 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.291369 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.291889 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.292415 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.292929 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.293862 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.294454 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.295071 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.295617 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.296153 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.296658 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.297164 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.297694 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.298194 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.298723 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.299245 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.299760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.300271 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.300797 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.301329 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.301834 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.302375 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.302924 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.303891 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.304453 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.304957 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.305389 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.305879 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.306397 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.306933 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.307462 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.307967 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.308474 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.309018 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.309532 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.310091 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.310613 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.311136 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.311632 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.311808 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.context [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07dec559-bc61-4440-a91c-9dffeca16423(cell1) {{(pid=103187) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 09:49:44.312131 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.312648 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.313158 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.313701 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.314209 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.314744 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.315238 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.315750 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.316251 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.316754 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.317255 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.317755 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.318267 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.318790 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.319319 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.319546 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:49:44.319796 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.320314 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.320812 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.321327 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.321879 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.322375 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:49:44.322501 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.322918 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.323421 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.323775 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:49:44.323940 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.324439 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.324965 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.325518 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.326032 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.326631 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.327141 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.327470 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:49:44.328063 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.328606 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.329121 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.329660 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.330165 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.330681 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.331180 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.331307 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Registered counter for database nova_cell0 Jun 29 09:49:44.331684 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.332280 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.332802 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.333319 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.333843 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.334340 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.334865 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.335356 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.335871 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.336379 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.336891 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.337400 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.338031 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.338534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.339077 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.339594 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.340143 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.340669 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.341267 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.341410 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Registered counter for database nova_cell1 Jun 29 09:49:44.341782 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.342296 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.342845 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.343366 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.343887 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.344410 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.344895 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.345945 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.346474 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.347037 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.347789 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.348301 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.348847 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.349395 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.349834 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.350277 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.350755 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.351228 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.351602 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.352023 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.352402 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.352858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.353380 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.353897 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.354086 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.354529 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.355037 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.355439 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.355927 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.356514 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.357079 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.357581 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.357920 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.358083 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.358634 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.359137 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.359657 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.360177 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.360707 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.361239 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.361743 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.362278 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.362803 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.363317 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.363850 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.364369 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.364901 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.365389 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.365888 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.366386 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.366905 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.366997 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.367410 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.367977 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.368543 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.369075 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.369609 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.370131 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.370694 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.371203 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.371735 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.372329 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.372860 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.373382 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.373929 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.374431 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.374978 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.375503 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.376009 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.376518 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.377033 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.377583 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.378123 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.378657 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.379171 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.379689 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.380229 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.380770 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.381300 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.381853 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.382385 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.382944 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.383475 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.383996 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.384516 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.385063 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.385613 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.386181 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.386757 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.387274 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.387851 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.388411 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.388997 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.389531 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.390116 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.390709 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.391250 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.391783 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.392298 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:49:44.392700 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 09:49:44.605598 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.621948 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO dbcounter [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Registered counter for database nova_cell0 Jun 29 09:49:44.632157 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_db.sqlalchemy.engines [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.637551 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writer thread running {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.639099 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Registered counter for database nova_api Jun 29 09:49:44.660323 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.672044 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.772740 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.context [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07dec559-bc61-4440-a91c-9dffeca16423(cell1) {{(pid=103186) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 09:49:44.778890 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:49:44.782131 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:49:44.783415 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:49:44.787070 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_concurrency.lockutils [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:49:44.791141 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Registered counter for database nova_cell0 Jun 29 09:49:44.801020 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Registered counter for database nova_cell1 Jun 29 09:49:44.814080 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.817195 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.821373 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.828681 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:44.981243 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:49:44.982673 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO dbcounter [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Registered counter for database nova_cell0 Jun 29 09:49:44.989230 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:49:44.993775 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG oslo_db.sqlalchemy.engines [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:49:44.998900 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writer thread running {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:49:45.324945 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:49:45.332787 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:49:45.336956 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:49:45.343071 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: WARNING keystonemiddleware.auth_token [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:49:45.348746 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55624ab379c0 pid: 103187 (default app) Jun 29 09:49:45.350874 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:49:45.352090 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jun 29 09:49:45.352869 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Jun 29 09:49:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:49:45.675937 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:49:45.681948 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: WARNING keystonemiddleware.auth_token [None req-70356646-72b1-4e28-a608-4c74e2295941 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:49:45.687482 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55624ab379c0 pid: 103186 (default app) Jun 29 09:51:02.971604 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:02.973280 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Jun 29 09:51:02.977795 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:02.992147 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_api:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:02.994065 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_cell1:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:02.995353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_cell0:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:02.996498 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_cell0:SELECT=3 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:03.443447 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-957e4998-8c92-42a8-9c20-d07e51c575f1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:03.474588 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-957e4998-8c92-42a8-9c20-d07e51c575f1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.492941 Jun 29 09:51:03.475373 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 09:51:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:51:05.615933 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:05.616998 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-4e0e1ae3-1ce3-41ae-8c4a-69281d669809 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Jun 29 09:51:05.618423 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:05.696527 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-14eb4270-bda7-4b45-a958-6f96350479a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "ram": 256}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:05.716444 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:51:05.716444 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: warnings.warn(msg) Jun 29 09:51:05.750747 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-14eb4270-bda7-4b45-a958-6f96350479a9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.125485 Jun 29 09:51:05.751988 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 09:51:05.770933 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=3 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:05.772293 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell1:SELECT=3 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:05.773447 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell0:SELECT=3 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:05.774458 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:05.998455 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-ba4279bd-6bda-4c1c-b1b3-ecef551cb123 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:06.001146 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:51:06.001146 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jun 29 09:51:06.095764 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-ba4279bd-6bda-4c1c-b1b3-ecef551cb123 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.332138 Jun 29 09:51:06.098717 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 09:51:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:51:08.400634 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-14eb4270-bda7-4b45-a958-6f96350479a9 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:08.402270 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-14eb4270-bda7-4b45-a958-6f96350479a9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Jun 29 09:51:08.403401 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:08.536156 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-518b19bc-a319-46b7-84e7-202bef779f92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:08.555113 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:51:08.555113 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jun 29 09:51:08.574866 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-518b19bc-a319-46b7-84e7-202bef779f92 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161974 Jun 29 09:51:08.575531 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 09:51:08.588033 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-156a62ba-58d2-4fd5-90c2-b650b73e9e99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:08.589765 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:51:08.589765 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: warnings.warn(msg) Jun 29 09:51:08.627022 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-156a62ba-58d2-4fd5-90c2-b650b73e9e99 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042678 Jun 29 09:51:08.627696 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 09:51:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:51:10.750944 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-518b19bc-a319-46b7-84e7-202bef779f92 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:10.752063 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-518b19bc-a319-46b7-84e7-202bef779f92 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Jun 29 09:51:10.752529 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:10.825497 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-8d5e3e4f-a50e-428b-bfcb-036bf8e43040 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:10.851598 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-8d5e3e4f-a50e-428b-bfcb-036bf8e43040 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091680 Jun 29 09:51:10.852951 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:51:10.866358 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-6f0b0a85-582c-4744-8edd-3408c77c9533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:10.896296 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-6f0b0a85-582c-4744-8edd-3408c77c9533 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034421 Jun 29 09:51:10.897234 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 09:51:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:51:13.176880 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-8d5e3e4f-a50e-428b-bfcb-036bf8e43040 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:13.178010 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-8d5e3e4f-a50e-428b-bfcb-036bf8e43040 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jun 29 09:51:13.178348 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:13.254331 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-76381c48-e3f7-493a-aefa-44636b82c818 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "name": "ds2G", "swap": 0, "id": "d3"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:13.273147 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-76381c48-e3f7-493a-aefa-44636b82c818 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087805 Jun 29 09:51:13.273707 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:51:13.286864 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-af6cf802-5ee3-4f8f-bc06-ce65873f1aa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:13.312461 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-af6cf802-5ee3-4f8f-bc06-ce65873f1aa9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029439 Jun 29 09:51:13.313280 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 09:51:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:51:15.488946 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-76381c48-e3f7-493a-aefa-44636b82c818 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:15.489972 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-76381c48-e3f7-493a-aefa-44636b82c818 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 29 09:51:15.490374 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:15.554436 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7465f5ce-4f90-4109-a924-93c1cb1074bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:15.574435 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7465f5ce-4f90-4109-a924-93c1cb1074bf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076256 Jun 29 09:51:15.581855 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:51:15.586634 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-343fb0e6-8446-4960-869d-8fbc5bb2b5d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:15.623432 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-343fb0e6-8446-4960-869d-8fbc5bb2b5d2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040478 Jun 29 09:51:15.623946 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 09:51:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:51:17.727773 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7465f5ce-4f90-4109-a924-93c1cb1074bf admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:17.728798 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7465f5ce-4f90-4109-a924-93c1cb1074bf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 29 09:51:17.729189 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:17.800142 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-ca0533b6-20ce-45c6-8298-2112a51f1b00 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:17.832686 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-ca0533b6-20ce-45c6-8298-2112a51f1b00 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.096927 Jun 29 09:51:17.833229 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 09:51:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:19.998339 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7465f5ce-4f90-4109-a924-93c1cb1074bf admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:19.999501 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7465f5ce-4f90-4109-a924-93c1cb1074bf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002512 Jun 29 09:51:20.008405 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:20.071140 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-77e4e96f-e78b-4765-ad16-cbd0820b9f99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 512, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:20.093556 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-77e4e96f-e78b-4765-ad16-cbd0820b9f99 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085752 Jun 29 09:51:20.094108 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:51:20.108463 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-b32fcbf3-b719-491e-8381-c8c495d0dc17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:20.134347 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-b32fcbf3-b719-491e-8381-c8c495d0dc17 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031439 Jun 29 09:51:20.134993 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 09:51:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:51:22.256607 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-77e4e96f-e78b-4765-ad16-cbd0820b9f99 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:22.257663 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-77e4e96f-e78b-4765-ad16-cbd0820b9f99 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 29 09:51:22.258057 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:22.334771 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-a42dc013-ad47-404c-a6d9-9d35999707ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:22.359579 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-a42dc013-ad47-404c-a6d9-9d35999707ef admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094871 Jun 29 09:51:22.360317 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 09:51:22.373032 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-6d17c87a-d2d9-4a46-87bf-151b9440c8d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:22.406990 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-6d17c87a-d2d9-4a46-87bf-151b9440c8d1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037706 Jun 29 09:51:22.407750 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 09:51:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:51:25.050179 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-a42dc013-ad47-404c-a6d9-9d35999707ef admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:25.052137 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-a42dc013-ad47-404c-a6d9-9d35999707ef admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002459 Jun 29 09:51:25.052576 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:25.143823 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-43cdd599-e7cd-4ddb-99a0-ac2159ef40bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:25.165812 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-43cdd599-e7cd-4ddb-99a0-ac2159ef40bc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.105889 Jun 29 09:51:25.166390 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:51:25.179645 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-6ed888af-c82e-4c00-aba3-c9f7f75f072a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:25.207112 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-6ed888af-c82e-4c00-aba3-c9f7f75f072a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031062 Jun 29 09:51:25.208120 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 09:51:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:51:27.307339 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-43cdd599-e7cd-4ddb-99a0-ac2159ef40bc admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:27.308375 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-43cdd599-e7cd-4ddb-99a0-ac2159ef40bc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Jun 29 09:51:27.309069 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:27.370098 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-57446a2d-cc72-4177-aeb9-ad414dbc7eda admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:27.390477 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-57446a2d-cc72-4177-aeb9-ad414dbc7eda admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075396 Jun 29 09:51:27.391071 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 09:51:27.403015 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-a8aee31d-1522-42e4-bf86-ac392c17b80d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:27.427766 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-a8aee31d-1522-42e4-bf86-ac392c17b80d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028530 Jun 29 09:51:27.428567 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 09:51:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:51:29.550425 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-57446a2d-cc72-4177-aeb9-ad414dbc7eda admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:29.551537 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-57446a2d-cc72-4177-aeb9-ad414dbc7eda admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jun 29 09:51:29.552122 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:29.618433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d0008d3a-ed7f-438e-b7a8-fc509d161094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "id": "5", "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:29.637651 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d0008d3a-ed7f-438e-b7a8-fc509d161094 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079131 Jun 29 09:51:29.640435 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 09:51:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 09:51:29.652431 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-0dd9c37f-fcf3-4d23-97b0-c292dab66b2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:29.683216 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-0dd9c37f-fcf3-4d23-97b0-c292dab66b2a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034677 Jun 29 09:51:29.684084 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 09:51:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:51:54.280760 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d0008d3a-ed7f-438e-b7a8-fc509d161094 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:54.281775 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d0008d3a-ed7f-438e-b7a8-fc509d161094 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 29 09:51:54.282166 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:54.293439 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:54.345973 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-5e129274-2117-4efc-af3f-988039f223d9 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:54.362989 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-5e129274-2117-4efc-af3f-988039f223d9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074602 Jun 29 09:51:54.363538 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 09:51:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:55.292851 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d0008d3a-ed7f-438e-b7a8-fc509d161094 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:55.293916 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d0008d3a-ed7f-438e-b7a8-fc509d161094 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 29 09:51:55.294314 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:55.498920 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-54bc6b61-502d-459a-ad5c-064d9e933ca0 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:55.504947 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.wsgi [None req-54bc6b61-502d-459a-ad5c-064d9e933ca0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-54bc6b61-502d-459a-ad5c-064d9e933ca0 admin admin] Request method failure captured: Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Accept: application/json Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Accept-Encoding: gzip, deflate Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Connection: keep-alive Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Content-Length: 0 Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Host: 10.222.0.52 Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Openstack-Api-Version: compute 2.90 Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Openstack-System-Scope: None Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: User-Agent: python-novaclient Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Auth-Token: gAAAAABivCC7OBGCD-fM4SxGYnpOoiJ6rAAq-KeFYBIbaAt7VJINWprecNfGvW6q5cKMBfpE-YJYGIp5RCqKZnFW9ccR1eOjN2dTn2EKbJarYlWSqSE8AVy1VtVpWU8Ro6fSVKn-WDNIYcFHOU5GwLjeKUMrbk3nDokVUadLgbXUmtXUbf3EY4Q Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Domain-Id: None Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Domain-Name: None Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Identity-Status: Confirmed Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Is-Admin-Project: True Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Domain-Id: default Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Domain-Name: Default Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Name: admin Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Role: admin,member,reader Jun 29 09:51:55.508273 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Roles: admin,member,reader Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant: admin Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant-Name: admin Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User: admin Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Domain-Id: default Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Domain-Name: Default Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Id: a021026b1cd24ba98923ebdb4a56f71f Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Name: admin Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: method: > Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: exception: Flavor 42 could not be found. Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: action_args: {'id': '42'} Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:51:55.509914 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:55.510858 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.512311 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-54bc6b61-502d-459a-ad5c-064d9e933ca0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:51:55.513444 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-54bc6b61-502d-459a-ad5c-064d9e933ca0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067000 Jun 29 09:51:55.513444 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 09:51:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 09:51:55.519809 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-40463da8-2ec7-4609-9109-b9eef9ee31b5 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:55.522897 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:51:55.542851 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-40463da8-2ec7-4609-9109-b9eef9ee31b5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026617 Jun 29 09:51:55.543422 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 09:51:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:55.553716 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-5b5d7bf7-4f43-4ae1-af52-9875eee0fc7d admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:55.576525 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-5b5d7bf7-4f43-4ae1-af52-9875eee0fc7d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026501 Jun 29 09:51:55.577083 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 09:51:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:55.586845 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-1d2257c0-6506-4cc0-98bd-bf25a6143b90 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:55.593389 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.wsgi [None req-1d2257c0-6506-4cc0-98bd-bf25a6143b90 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-1d2257c0-6506-4cc0-98bd-bf25a6143b90 admin admin] Request method failure captured: Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Accept: application/json Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Accept-Encoding: gzip, deflate Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Connection: keep-alive Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Content-Length: 0 Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Host: 10.222.0.52 Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Openstack-Api-Version: compute 2.90 Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Openstack-System-Scope: None Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: User-Agent: python-novaclient Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Auth-Token: gAAAAABivCC7OBGCD-fM4SxGYnpOoiJ6rAAq-KeFYBIbaAt7VJINWprecNfGvW6q5cKMBfpE-YJYGIp5RCqKZnFW9ccR1eOjN2dTn2EKbJarYlWSqSE8AVy1VtVpWU8Ro6fSVKn-WDNIYcFHOU5GwLjeKUMrbk3nDokVUadLgbXUmtXUbf3EY4Q Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Domain-Id: None Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Domain-Name: None Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Identity-Status: Confirmed Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Is-Admin-Project: True Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Domain-Id: default Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Domain-Name: Default Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Name: admin Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Role: admin,member,reader Jun 29 09:51:55.597039 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Roles: admin,member,reader Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant: admin Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant-Name: admin Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User: admin Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Domain-Id: default Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Domain-Name: Default Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Id: a021026b1cd24ba98923ebdb4a56f71f Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Name: admin Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: method: > Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: exception: Flavor 42 could not be found. Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: action_args: {'id': '42'} Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:51:55.598433 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:55.599298 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:55.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-1d2257c0-6506-4cc0-98bd-bf25a6143b90 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:51:55.601786 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-1d2257c0-6506-4cc0-98bd-bf25a6143b90 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015231 Jun 29 09:51:55.601786 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 09:51:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 09:51:56.419502 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-5b5d7bf7-4f43-4ae1-af52-9875eee0fc7d admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:56.420513 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-5b5d7bf7-4f43-4ae1-af52-9875eee0fc7d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 29 09:51:56.420948 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:56.620999 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-18886493-e21b-4bbb-9a5c-886702a459cc admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:56.627345 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.wsgi [None req-18886493-e21b-4bbb-9a5c-886702a459cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-18886493-e21b-4bbb-9a5c-886702a459cc admin admin] Request method failure captured: Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Accept: application/json Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Accept-Encoding: gzip, deflate Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Connection: keep-alive Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Content-Length: 0 Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Host: 10.222.0.52 Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Openstack-Api-Version: compute 2.90 Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Openstack-System-Scope: None Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: User-Agent: python-novaclient Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Auth-Token: gAAAAABivCC8lhHD5Qv3_eZuJCqOJAZseriqCS3xWRIE0uw5bDrM5hv_0RRUGgmmaWrMJRt8xHkgkGi-E2BSNuCItHZsq25xvCcoQb7cXZXKXyneoiMst-ILQQTRrxL9Em3PSlKULyBiiELTe1Wy8cp8Gshe3-8tJBiwGrqiNVHCMkMi_yTgjMQ Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Domain-Id: None Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Domain-Name: None Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Identity-Status: Confirmed Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Is-Admin-Project: True Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Domain-Id: default Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Domain-Name: Default Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Name: admin Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Role: admin,member,reader Jun 29 09:51:56.628849 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Roles: admin,member,reader Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant: admin Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant-Name: admin Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User: admin Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Domain-Id: default Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Domain-Name: Default Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Id: a021026b1cd24ba98923ebdb4a56f71f Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Name: admin Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: method: > Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: exception: Flavor 84 could not be found. Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: action_args: {'id': '84'} Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:51:56.630445 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:56.631518 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.632783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-18886493-e21b-4bbb-9a5c-886702a459cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:51:56.634071 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-18886493-e21b-4bbb-9a5c-886702a459cc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065898 Jun 29 09:51:56.634071 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 09:51:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 09:51:56.640444 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-9b5ffb8f-e560-4979-9a77-dc65dfbd49eb admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:56.654490 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-9b5ffb8f-e560-4979-9a77-dc65dfbd49eb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017828 Jun 29 09:51:56.655118 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 09:51:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:56.664775 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d1ef40d3-3229-491e-bed3-a6a2bf76c877 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:56.680524 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d1ef40d3-3229-491e-bed3-a6a2bf76c877 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019285 Jun 29 09:51:56.681065 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 09:51:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:56.691034 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7176f05b-6718-412e-854c-def72ca40d93 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:56.696797 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.wsgi [None req-7176f05b-6718-412e-854c-def72ca40d93 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7176f05b-6718-412e-854c-def72ca40d93 admin admin] Request method failure captured: Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Accept: application/json Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Accept-Encoding: gzip, deflate Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Connection: keep-alive Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Content-Length: 0 Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Host: 10.222.0.52 Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Openstack-Api-Version: compute 2.90 Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Openstack-System-Scope: None Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: User-Agent: python-novaclient Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Auth-Token: gAAAAABivCC8lhHD5Qv3_eZuJCqOJAZseriqCS3xWRIE0uw5bDrM5hv_0RRUGgmmaWrMJRt8xHkgkGi-E2BSNuCItHZsq25xvCcoQb7cXZXKXyneoiMst-ILQQTRrxL9Em3PSlKULyBiiELTe1Wy8cp8Gshe3-8tJBiwGrqiNVHCMkMi_yTgjMQ Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Domain-Id: None Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Domain-Name: None Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Identity-Status: Confirmed Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Is-Admin-Project: True Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Domain-Id: default Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Domain-Name: Default Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Name: admin Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Role: admin,member,reader Jun 29 09:51:56.698353 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Roles: admin,member,reader Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant: admin Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant-Name: admin Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User: admin Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Domain-Id: default Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Domain-Name: Default Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Id: a021026b1cd24ba98923ebdb4a56f71f Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Name: admin Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: method: > Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: exception: Flavor 84 could not be found. Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: action_args: {'id': '84'} Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:51:56.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:56.700534 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:56.701718 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-7176f05b-6718-412e-854c-def72ca40d93 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:51:56.702945 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-7176f05b-6718-412e-854c-def72ca40d93 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012517 Jun 29 09:51:56.702945 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 09:51:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 09:51:57.556753 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-d1ef40d3-3229-491e-bed3-a6a2bf76c877 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:57.557818 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-d1ef40d3-3229-491e-bed3-a6a2bf76c877 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 29 09:51:57.558436 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:57.758135 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-d5ebf706-466c-4b62-aaef-a6126729e20f admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:57.768746 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.wsgi [None req-d5ebf706-466c-4b62-aaef-a6126729e20f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-d5ebf706-466c-4b62-aaef-a6126729e20f admin admin] Request method failure captured: Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Accept: application/json Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Accept-Encoding: gzip, deflate Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Connection: keep-alive Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Content-Length: 0 Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Host: 10.222.0.52 Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Openstack-Api-Version: compute 2.90 Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Openstack-System-Scope: None Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: User-Agent: python-novaclient Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Auth-Token: gAAAAABivCC9uCmkqxZc73SH4FwlZbXtZwF57hL9SkrSinjEgI3addctKOQiYMwCm-_fhZ-wAzTSRL2MYwBHfFG-BG0WNVNIDSNj13l74bUsLuCTrqEWd7Dayn-CsYcT6dKs2qiDe11HQdNIsSGCNKlWm-oxv90uuRZFKQbpOjrJ-T8eE0zkllU Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Domain-Id: None Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Domain-Name: None Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Identity-Status: Confirmed Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Is-Admin-Project: True Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Domain-Id: default Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Domain-Name: Default Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Project-Name: admin Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Role: admin,member,reader Jun 29 09:51:57.771222 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Roles: admin,member,reader Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant: admin Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-Tenant-Name: admin Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User: admin Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Domain-Id: default Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Domain-Name: Default Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Id: a021026b1cd24ba98923ebdb4a56f71f Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: X-User-Name: admin Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: method: > Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: exception: Flavor 451 could not be found. Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: action_args: {'id': '451'} Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:51:57.772535 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:57.773332 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.774491 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-d5ebf706-466c-4b62-aaef-a6126729e20f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:51:57.775771 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-d5ebf706-466c-4b62-aaef-a6126729e20f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.076995 Jun 29 09:51:57.775771 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 09:51:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 09:51:57.782976 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-46b7228a-da02-443b-a1c3-2d28b42a9b1b admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:57.796867 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-46b7228a-da02-443b-a1c3-2d28b42a9b1b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017453 Jun 29 09:51:57.797391 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 09:51:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:57.807037 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:57.821235 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017716 Jun 29 09:51:57.821782 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 09:51:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:51:57.831380 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-db020b47-4c64-46d6-acba-b5759f870b4f admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:57.837294 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.wsgi [None req-db020b47-4c64-46d6-acba-b5759f870b4f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-db020b47-4c64-46d6-acba-b5759f870b4f admin admin] Request method failure captured: Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Accept: application/json Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Accept-Encoding: gzip, deflate Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Connection: keep-alive Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Content-Length: 0 Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Host: 10.222.0.52 Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Openstack-Api-Version: compute 2.90 Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Openstack-System-Scope: None Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: User-Agent: python-novaclient Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Auth-Token: gAAAAABivCC9uCmkqxZc73SH4FwlZbXtZwF57hL9SkrSinjEgI3addctKOQiYMwCm-_fhZ-wAzTSRL2MYwBHfFG-BG0WNVNIDSNj13l74bUsLuCTrqEWd7Dayn-CsYcT6dKs2qiDe11HQdNIsSGCNKlWm-oxv90uuRZFKQbpOjrJ-T8eE0zkllU Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Domain-Id: None Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Domain-Name: None Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Identity-Status: Confirmed Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Is-Admin-Project: True Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Domain-Id: default Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Domain-Name: Default Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Project-Name: admin Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Role: admin,member,reader Jun 29 09:51:57.838914 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Roles: admin,member,reader Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d79cb8b2f46e418d955fc3be77ed8c7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant: admin Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant-Id: d79cb8b2f46e418d955fc3be77ed8c7a Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-Tenant-Name: admin Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User: admin Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Domain-Id: default Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Domain-Name: Default Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Id: a021026b1cd24ba98923ebdb4a56f71f Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: X-User-Name: admin Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: method: > Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: exception: Flavor 451 could not be found. Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: action_args: {'id': '451'} Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:51:57.840579 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:57.841558 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: ERROR nova.api.openstack.wsgi Jun 29 09:51:57.843068 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-db020b47-4c64-46d6-acba-b5759f870b4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:51:57.844653 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-db020b47-4c64-46d6-acba-b5759f870b4f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012677 Jun 29 09:51:57.844653 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 09:51:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 09:51:58.673330 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:58.674355 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 29 09:51:58.674750 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:58.887496 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-05d3cef0-a3ba-4d8d-843b-b0f74e6fe4a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:58.912598 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-05d3cef0-a3ba-4d8d-843b-b0f74e6fe4a9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083921 Jun 29 09:51:58.913366 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 09:51:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:51:59.737099 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:51:59.738393 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Jun 29 09:51:59.738976 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:51:59.934284 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-ecb66eb4-a5b9-45d7-9eec-ccdf243085e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:51:59.955548 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-ecb66eb4-a5b9-45d7-9eec-ccdf243085e6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079305 Jun 29 09:51:59.956010 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 09:51:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:52:00.809572 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:00.810622 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 29 09:52:00.811043 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:52:01.009371 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-9df0d005-a478-4d8f-998b-2f7cabce3e67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:52:01.033152 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-9df0d005-a478-4d8f-998b-2f7cabce3e67 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086211 Jun 29 09:52:01.033639 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 09:52:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:52:01.903814 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:01.904835 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 29 09:52:01.905263 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:52:02.223340 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-770ad57c-a4d6-48a8-850a-1c44fa3ff981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:52:02.242944 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-770ad57c-a4d6-48a8-850a-1c44fa3ff981 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084798 Jun 29 09:52:02.243511 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 09:52:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:52:03.101411 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:03.102468 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 29 09:52:03.102900 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:52:03.326196 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-795cb9ca-df7a-4a56-b2ca-47e6d0a63eb2 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:03.348142 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-795cb9ca-df7a-4a56-b2ca-47e6d0a63eb2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.105822 Jun 29 09:52:03.348847 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Jun 29 09:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:52:53.350229 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:53.351328 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-2ce66360-2c88-4018-9923-6ecdda9838a1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jun 29 09:52:53.351907 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 09:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:52:53.362860 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:52:53.442448 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-dfafa9d0-56a1-4196-93a9-2b54efff67f9 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:53.471183 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-dfafa9d0-56a1-4196-93a9-2b54efff67f9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.112538 Jun 29 09:52:53.472248 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 09:52:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:52:53.500761 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-8882be81-ddd9-40e3-b612-316c21073664 admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:53.504229 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG dbcounter [-] [103186] Writing DB stats nova_api:SELECT=14 {{(pid=103186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:52:53.510168 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-8882be81-ddd9-40e3-b612-316c21073664 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013034 Jun 29 09:52:53.511023 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Wed Jun 29 09:52:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:52:53.523422 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-17d41427-dd54-4864-9039-1353a9f67f67 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:53.532307 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-17d41427-dd54-4864-9039-1353a9f67f67 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012515 Jun 29 09:52:53.532902 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Wed Jun 29 09:52:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:52:53.546391 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:53.555183 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013191 Jun 29 09:52:53.555798 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Wed Jun 29 09:52:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:52:53.568368 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-1997dbd0-909d-45fd-88d3-ed7cc6d5ac21 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:52:53.581011 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-1997dbd0-909d-45fd-88d3-ed7cc6d5ac21 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016287 Jun 29 09:52:53.581665 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Wed Jun 29 09:52:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:56:20.128239 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:20.129302 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jun 29 09:56:20.129696 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:56:20.273010 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=6 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:56:20.391648 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-fc1f46ab-e3e2-4672-9dfd-3f38acbfeddd admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:20.392807 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:56:20.392807 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jun 29 09:56:20.393999 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-fc1f46ab-e3e2-4672-9dfd-3f38acbfeddd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:20.394407 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-fc1f46ab-e3e2-4672-9dfd-3f38acbfeddd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:20.395212 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-fc1f46ab-e3e2-4672-9dfd-3f38acbfeddd admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:20.395626 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-fc1f46ab-e3e2-4672-9dfd-3f38acbfeddd admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:20.429828 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-fc1f46ab-e3e2-4672-9dfd-3f38acbfeddd admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.158332 Jun 29 09:56:20.430399 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 09:56:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:56:21.277189 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:21.278206 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 29 09:56:21.278614 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:56:21.475307 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-b3a046cf-98e5-48e6-85ab-24e1dddb6add admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:21.476478 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:56:21.476478 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jun 29 09:56:21.477680 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-b3a046cf-98e5-48e6-85ab-24e1dddb6add admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:21.478115 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-b3a046cf-98e5-48e6-85ab-24e1dddb6add admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:21.478919 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-b3a046cf-98e5-48e6-85ab-24e1dddb6add admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:21.479336 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-b3a046cf-98e5-48e6-85ab-24e1dddb6add admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:21.499515 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-b3a046cf-98e5-48e6-85ab-24e1dddb6add admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081632 Jun 29 09:56:21.500095 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 09:56:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:56:32.768999 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:32.770015 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 29 09:56:32.770455 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:56:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:56:32.913583 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell0:SELECT=4 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:56:32.914300 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_cell1:SELECT=4 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:56:32.915059 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG dbcounter [-] [103187] Writing DB stats nova_api:SELECT=8 {{(pid=103187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:56:32.966991 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-92513866-0933-4499-a83f-5f3c2514efd5 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:32.968170 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:56:32.968170 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jun 29 09:56:32.969347 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-92513866-0933-4499-a83f-5f3c2514efd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:32.969783 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-92513866-0933-4499-a83f-5f3c2514efd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:32.970584 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-92513866-0933-4499-a83f-5f3c2514efd5 admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:32.971020 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-92513866-0933-4499-a83f-5f3c2514efd5 admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:32.995829 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-92513866-0933-4499-a83f-5f3c2514efd5 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086729 Jun 29 09:56:32.996394 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 09:56:32 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:56:33.848155 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: DEBUG nova.api.openstack.wsgi [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] Calling method '>' {{(pid=103186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:33.849176 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: INFO nova.api.openstack.requestlog [None req-4eb13552-2ea1-4526-826c-d55d2877777f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 29 09:56:33.849579 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: [pid: 103186|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 09:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:56:34.044618 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG nova.api.openstack.wsgi [None req-9aa218c8-3331-411b-876d-d7d4045555a6 admin admin] Calling method '>' {{(pid=103187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:56:34.046396 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 09:56:34.046396 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: warnings.warn(msg) Jun 29 09:56:34.047260 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-9aa218c8-3331-411b-876d-d7d4045555a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:34.047700 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-9aa218c8-3331-411b-876d-d7d4045555a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:34.048505 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-9aa218c8-3331-411b-876d-d7d4045555a6 admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:56:34.048928 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: DEBUG oslo_concurrency.lockutils [None req-9aa218c8-3331-411b-876d-d7d4045555a6 admin admin] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:56:34.071647 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: INFO nova.api.openstack.requestlog [None req-9aa218c8-3331-411b-876d-d7d4045555a6 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083310 Jun 29 09:56:34.072228 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: [pid: 103187|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 09:56:33 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:57:29.215744 dv-cinder-768105-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 29 09:57:29.216699 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: Wed Jun 29 09:57:29 2022 - graceful shutdown triggered... Jun 29 09:57:29.217207 dv-cinder-768105-16-iscsi devstack@n-api.service[103186]: Gracefully killing worker 1 (pid: 103186)... Jun 29 09:57:29.217668 dv-cinder-768105-16-iscsi devstack@n-api.service[103187]: Gracefully killing worker 2 (pid: 103187)... Jun 29 09:57:30.217215 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: worker 1 buried after 1 seconds Jun 29 09:57:30.217215 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: worker 2 buried after 1 seconds Jun 29 09:57:30.217215 dv-cinder-768105-16-iscsi devstack@n-api.service[103185]: goodbye to uWSGI. Jun 29 09:57:30.218960 dv-cinder-768105-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 29 09:57:30.219542 dv-cinder-768105-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 29 09:57:30.222512 dv-cinder-768105-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 09:57:30.233867 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 09:57:30 2022] *** Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: nodename: dv-cinder-768105-16-iscsi Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: machine: x86_64 Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: clock source: unix Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: pcre jit disabled Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: detected number of CPU cores: 4 Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: current working directory: / Jun 29 09:57:30.235865 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: detected binary path: /usr/bin/uwsgi-core Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: your processes number limit is 47680 Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: your memory page size is 4096 bytes Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: detected max file descriptor number: 2048 Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: lock engine: pthread robust mutexes Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: thunder lock: enabled Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 09:57:30.236608 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 09:57:30.280670 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: Python main interpreter initialized at 0x55b189bfc9c0 Jun 29 09:57:30.280670 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: python threads support enabled Jun 29 09:57:30.280670 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: your server socket listen backlog is limited to 100 connections Jun 29 09:57:30.280670 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: your mercy for graceful operations on workers is 90 seconds Jun 29 09:57:30.281107 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 09:57:30.281107 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: *** Operational MODE: preforking *** Jun 29 09:57:30.281425 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: *** uWSGI is running in multiple interpreter mode *** Jun 29 09:57:30.281425 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: spawned uWSGI master process (pid: 117937) Jun 29 09:57:30.281611 dv-cinder-768105-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 09:57:30.283152 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: spawned uWSGI worker 1 (pid: 117950, cores: 1) Jun 29 09:57:30.283499 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: spawned uWSGI worker 2 (pid: 117951, cores: 1) Jun 29 09:57:30.283770 dv-cinder-768105-16-iscsi devstack@n-api.service[117937]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 09:57:30.945492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 09:57:30.957685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 09:57:32.146221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:57:32.146221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: from cryptography.utils import int_from_bytes Jun 29 09:57:32.146951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:57:32.146951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: from cryptography.utils import int_from_bytes Jun 29 09:57:32.148268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:57:32.148268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: from cryptography.utils import int_from_bytes Jun 29 09:57:32.148765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 09:57:32.148765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: from cryptography.utils import int_from_bytes Jun 29 09:57:34.557039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 09:57:34.557774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 09:57:34.557889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 09:57:34.558166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 09:57:34.558428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 09:57:34.558853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.559183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.559511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.559834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.560167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.560481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.560811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.561132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.561468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.561759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.562072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.562459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-16-iscsi {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.562712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.563028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.563341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.563661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.563998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.564323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.564630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.565139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.567899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.568159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.568414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.568754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.569146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-16-iscsi {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.569455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.581543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.582774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.583850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.584805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.585751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.586891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.587980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.589831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 09:57:34.590352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.590537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 09:57:34.591852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.591852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.592171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 09:57:34.592326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.592471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 09:57:34.592623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.592766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 09:57:34.592919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.593906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.594200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.594345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.594345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.594345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.594807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.594982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.595184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.595341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.595492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.595644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.595798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.595957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.596109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.596262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.596415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.596803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.596973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.597138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.597314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-16-iscsi {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.597521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.597668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.597829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.597982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.598127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.598292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.598438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.598623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.598787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.598966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.599126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.599281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.599434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.599578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.599720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.599863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.600049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.600204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.600353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.600497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.600648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.600791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.602832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.603905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.604181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.604332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.604476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.604635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.604789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-16-iscsi {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.604951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.605991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.606142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.606142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.606427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.606613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.606775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.606952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.607102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.607256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.607409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.607566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.607717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.607861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.608013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.608013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.608303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.608461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.608608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.608770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.608938 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.609144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.609294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.609450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.609603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.609754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.609992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.610146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.610289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.610438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.610637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.610807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.611150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.612472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.612702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.612913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.613063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.613222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.613374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.613528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.613672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.613825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.613980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.614139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.614297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.614449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.614640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.614791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.614961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.615110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.615273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.615496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.615649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.615793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.615953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.616104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.616104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.616399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.616542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.616685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.616838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.617133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.617306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.617453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.617604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.617757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.617908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.618065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.618217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.618378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.618378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.618809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.618996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.619155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.619341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.619486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.619630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.619630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.619911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.620054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.620206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.620350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.620516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.620676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.620827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.620978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.621131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.621282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.621895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.622660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.622817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.622974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.623119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.623270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.623442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.623594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.623738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.623881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.624032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.624184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.624337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.624489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.624638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.624790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.624933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.624933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.625214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.625369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.625549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.625748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.625901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.626051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.626210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.626356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.626507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.626689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.626845 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.626999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.627150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.627293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.627464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.627610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.627760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.628192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.628365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.628518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.628661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.628820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.628975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.629132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.629283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.629426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.629571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.629734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.629885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.630042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.630186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.630336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.630494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.630699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.630852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.630996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.631154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.631299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.631450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.632042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.632545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.632938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.632938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.633235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.633388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.633548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.633701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.633854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.634004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.634204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.634204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.634495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.634674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.634833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.634978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.635121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.635278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.635421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.635573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.635724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.635868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.636011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.636164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.636316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.636467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.636620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.636772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.636917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.637069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.637221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.637409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.637565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.637710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.637868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.638021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.638164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.638316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.638460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.638674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.638844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.638999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.639143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.639287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.639430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.639572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.639798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.639945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.640160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.640308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.640460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.640621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.640786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.640930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.641075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.641227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.641421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.641571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.641741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.642207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.642387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 09:57:34.642806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.643149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.643306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.643517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.643678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.643678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.643961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.644994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.645147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.645301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.645457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.645611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.645756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.645910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.646064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.646216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.646361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.646505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.646713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.646871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.647933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.648992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.649907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.650914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.651924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.652411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.652411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.652869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.652869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.653939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.654970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.655699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.656933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.658469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.660989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.661259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.661391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.661566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.661874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.662026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.662276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.662750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.663940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.664032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.664282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.664468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.664666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.664885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.665006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.665331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.665477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.665658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.665975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.666075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.666297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.666552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.666677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.666946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.667169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.667264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.667562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.667754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.667890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.668206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.668305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.668530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.668808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.668900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.669159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.669378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.669471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.669780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.669960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.670090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.670413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.670630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.670791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.671119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.671214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.671437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.671692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.671793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.672060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.672279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.672394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.672837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.672969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.673317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.673317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.673499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.673790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.673902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.673990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.674182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.674476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.674598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.674891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.675220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.675313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.675534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.675855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.676162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.676261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.676482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.676748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.676842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.677137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.677323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.677450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.677766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.677906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.678094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.678409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.678508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.678750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.679076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.679192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.679348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.679589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.679690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.679957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.680182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.680276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.680576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.680739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.680889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.681197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.681289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.681514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.681789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.681887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.682119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.682357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.682460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.683973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.684905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.685199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.685427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.685521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.685802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.686009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.686102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.686452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.686593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.686793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.687098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.687193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.687417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.687691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.687784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.688046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.689735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.689866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.689966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.690913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.691032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.691032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.691032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.691285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.691445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.691539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.696601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.696826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.696979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.697851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.698927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.699934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.700331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.700953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.700953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.700953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.700953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.700953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.701838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.702089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.709960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.710911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.711990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.712836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.713879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.714999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.715976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.717951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.718871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.719185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.719280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.719280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.719448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.719660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.719774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.720735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.720832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.720925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.721987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.722143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.722381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.722532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.723089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.723205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.723623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.723623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.723822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.723903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.724007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.724096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.724301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.724577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.724918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.725240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.725436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.725672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.725809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.726602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.726768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.726880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.726985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.726985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.727308 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.727434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.727646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.727769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.727960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.728241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.728361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.728608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.728720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.729879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.730013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.730212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.730395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.730539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.730966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.731100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.731203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.731802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.731920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.732848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.733075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.733220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.733391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.733728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.733836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.734009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.734156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.734328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.734637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.734745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.734980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.735077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.735308 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.735449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.735628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.735919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.736026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.736243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.736341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.736559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.736768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.736862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.737285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.737405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.737804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.737923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.738012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.738108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.738294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.738543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.738660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.738953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.739061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.739269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.739463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.739587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.739904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.740016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.740227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.740393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.740539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.740815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.740963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.741248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.741348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.741582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.741730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.741901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.742159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.742260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.742507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.742725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.742854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.743067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.743174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.743478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.743570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.743788 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.743943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.744263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.744412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.744511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.744705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.744840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.745678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.745902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.746795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.747202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.747528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.747716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.748717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.748900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.749063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.749225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.749379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.749530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.749697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.749850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.750977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.751136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.751136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.751423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.751585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.751744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.751903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.752081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.752233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.752398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.752563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.752772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.752958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.753111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.753111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.753424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.753577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.753737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.753906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.754058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.754221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.754383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.754535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.754741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.754741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.755046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.755197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.755363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.755524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.755691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.756052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.756226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.756381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.756562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.756866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.757038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.757192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.757683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.757874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.758259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.758446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.763568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.764521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.764708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.764926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.765100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.765287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.765450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.765602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.765763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.765917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.766076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.766238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.766390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.766660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.766660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.767223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.767400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.767877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.768056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.768596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.768780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.768955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.769113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.769280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.769433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.769592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.769767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.769927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.770889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.771047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.771047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.771362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.771523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.771692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.771855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.772027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.772027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.772334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.772488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.772639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.772639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.773990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.774201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.774356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.774534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.774534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.774917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.775096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.775252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.775412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.775587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.775753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.775905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.776069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.776069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.776369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.776621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.776789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.776967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.777131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.777283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.777283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.777599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.778119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.778303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.778791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.778967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.779151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.779312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.779465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.779631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.779783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.779933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.780096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.780256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.780407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.780576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.781359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.781359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.781642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.781765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.781888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.782010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.782123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.782353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.782525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.782759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.782929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.783090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.783242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.783414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.783763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.783929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.784119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.784286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.784438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.784599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.785950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.786252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.786411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.786594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.786766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.786928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.787892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.788723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.789978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.790139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.790299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.790450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.790654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.790832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.790995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.791147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.791299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.791458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.791617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.791770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.791935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.792088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.792248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.792416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.792416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.792713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.792887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.793046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.793207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.793367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.793518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.793680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.793850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.794973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.795133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.795285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.795448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.795448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.795759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.795918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.796076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.796229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.796394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.796547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.796721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.796873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.797201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.797378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.797545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.797706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.798077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.798494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.798494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.799184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.799381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.799561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.799771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.799950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.799950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.800314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.800512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.800681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.800858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.801027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.801187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.801365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.801533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.801736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.801903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.802083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.802250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.802432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.802617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.802798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.802973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.803140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.803140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.803446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.803600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.803757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.803919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.804078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.804257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.804419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.804571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.804723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.804882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.805986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.806162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.806314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.806473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.806653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.806811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.806973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.807126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.807285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.807436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.807593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.807753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.807920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.808093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.808244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.808644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.808834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.808992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.809319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.809479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.809479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.809783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.809957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.810811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.810928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.811976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.812927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.813831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.814996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.815935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.816975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.817999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.818912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.819922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.820892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.821931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.822998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.823926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.824896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.825961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.826982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.827877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.828957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.829687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.830962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.831318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.831318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.831596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.831700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.831921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.832954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.833953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.834121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.834268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.834447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.834641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.834811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.834916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.835139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.835265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.835460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.835554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.835764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.835855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.836996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.837116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.837304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.837404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.837634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.837738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.837912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.838041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.838228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.838733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.838917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.839912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.840125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.840218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.840423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.840521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.840722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.840822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.841925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.842955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.843164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.843256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.843468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.843575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.843769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.843867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.844099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.844190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.844433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.844570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.844750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.844842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.845987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.846075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.846299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.846381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.846658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.846823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.846960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.847044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.847298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.847526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.847628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.847770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.847925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.848087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.848259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.848405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.848607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.848728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.848931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.849051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.849274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.849373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.849604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.849700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.849922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.850021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.850243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.850343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.850541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.850647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.850820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 09:57:34.850943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.851194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.851513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.851831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.852140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.852467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.852776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.853085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.853398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.853705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.854014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.854329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.854664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.854993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.855315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.855626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.855948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.856272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.856619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.856930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.857274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.857604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.857914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.858237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.858542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 09:57:34.858805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 09:57:34.913012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Registered counter for database nova_api Jun 29 09:57:34.920206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Registered counter for database nova_api Jun 29 09:57:34.935836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:34.941181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:34.943457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:34.948119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.002262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.context [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07dec559-bc61-4440-a91c-9dffeca16423(cell1) {{(pid=117951) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 09:57:35.007138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.context [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),07dec559-bc61-4440-a91c-9dffeca16423(cell1) {{(pid=117950) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 09:57:35.007418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:57:35.009086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:57:35.009945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:57:35.011395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:57:35.012033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:57:35.013093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:57:35.013924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:57:35.014138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Registered counter for database nova_cell0 Jun 29 09:57:35.015966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:57:35.018037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Registered counter for database nova_cell0 Jun 29 09:57:35.019305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Registered counter for database nova_cell1 Jun 29 09:57:35.022443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Registered counter for database nova_cell1 Jun 29 09:57:35.027095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:35.029051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:35.031114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:35.033171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:35.036606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.037158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.040102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.042871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.189137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO dbcounter [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Registered counter for database nova_cell0 Jun 29 09:57:35.196140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO dbcounter [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Registered counter for database nova_cell0 Jun 29 09:57:35.197267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_db.sqlalchemy.engines [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:35.202483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writer thread running {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.203779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_db.sqlalchemy.engines [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 09:57:35.208687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writer thread running {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 09:57:35.531862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:57:35.539550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:57:35.541239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:57:35.548646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:57:35.889860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:57:35.896166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: WARNING keystonemiddleware.auth_token [None req-871ccc4b-3157-45b0-82c3-5b9fa904ff58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:57:35.898141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 09:57:35.901603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b189bfc9c0 pid: 117951 (default app) Jun 29 09:57:35.904279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: WARNING keystonemiddleware.auth_token [None req-4b8ab0d6-8dc8-4863-98f3-dc3acfdd8665 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 09:57:35.909748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b189bfc9c0 pid: 117950 (default app) Jun 29 09:58:17.628671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:17.630519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:17.632156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:17.632945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:19.012476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdf8927f-db13-4679-b9a1-c74078c12b75 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Action: 'create', calling method: .version_select at 0x7f3871ab53a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-791264777", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdf8927f-db13-4679-b9a1-c74078c12b75 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Request method failure captured: Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 121 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCI5On_03z4e1FmJ95L5r4Gax-SrwDIRULkMXPneEVmTwKCH5ey8hE6hig59JO7qRlwtPTKOdupN7ORKbH9FnQxAHbkrgeFnG75V14dPJym6zE0bG14z-f7r3lsZ6Xc6pEIdUC0jWYxvgppAnaCiqdStPmYnCPDQlQLu57OxIzWv0B8 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:58:19.044990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: aba55f5cda1441249e414223ba8f0269 Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-791264777", "metadata": {"Type": "work"}}} Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 09:58:19.046384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-791264777', 'metadata': {'Type': 'work'}}}} Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise error Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi '#$%' Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:58:19.047267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 09:58:19.048595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 09:58:19.049844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 09:58:19.049844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.049844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fdf8927f-db13-4679-b9a1-c74078c12b75 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:58:19.049844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fdf8927f-db13-4679-b9a1-c74078c12b75 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.436146 Jun 29 09:58:19.052364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 09:58:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1443 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 09:58:19.623644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5fe0cea8-c54d-4194-b18a-f6460121026a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Action: 'create', calling method: .version_select at 0x7f3871aebdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-183251277", "metadata": {"Type": "work"}}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5fe0cea8-c54d-4194-b18a-f6460121026a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Request method failure captured: Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 119 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCI5On_03z4e1FmJ95L5r4Gax-SrwDIRULkMXPneEVmTwKCH5ey8hE6hig59JO7qRlwtPTKOdupN7ORKbH9FnQxAHbkrgeFnG75V14dPJym6zE0bG14z-f7r3lsZ6Xc6pEIdUC0jWYxvgppAnaCiqdStPmYnCPDQlQLu57OxIzWv0B8 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 09:58:19.632078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: aba55f5cda1441249e414223ba8f0269 Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-183251277", "metadata": {"Type": "work"}}} Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: Jun 29 09:58:19.633582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-183251277', 'metadata': {'Type': 'work'}}}} Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise error Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi '0' Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:58:19.634364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 09:58:19.636676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 09:58:19.642082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 09:58:19.642082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.643538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5fe0cea8-c54d-4194-b18a-f6460121026a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:58:19.644940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5fe0cea8-c54d-4194-b18a-f6460121026a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.585937 Jun 29 09:58:19.656018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c753f17d-49f3-4e0f-ae12-a262732be96a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Action: 'create', calling method: .version_select at 0x7f3871add700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1578949715", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c753f17d-49f3-4e0f-ae12-a262732be96a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Request method failure captured: Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 119 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCI5On_03z4e1FmJ95L5r4Gax-SrwDIRULkMXPneEVmTwKCH5ey8hE6hig59JO7qRlwtPTKOdupN7ORKbH9FnQxAHbkrgeFnG75V14dPJym6zE0bG14z-f7r3lsZ6Xc6pEIdUC0jWYxvgppAnaCiqdStPmYnCPDQlQLu57OxIzWv0B8 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:58:19.661397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: aba55f5cda1441249e414223ba8f0269 Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1578949715", "metadata": {"Type": "work"}}} Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 09:58:19.663415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1578949715', 'metadata': {'Type': 'work'}}}} Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise error Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi '' Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:58:19.664212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 09:58:19.665478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 09:58:19.667618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 09:58:19.667618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:19.667618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c753f17d-49f3-4e0f-ae12-a262732be96a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:58:19.667618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c753f17d-49f3-4e0f-ae12-a262732be96a tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013319 Jun 29 09:58:19.667618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 09:58:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 29 09:58:19.668448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 09:58:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 607 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 09:58:19.680967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6548041-fb99-4fae-8fe7-589490aa1256 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Calling method '.version_select at 0x7f3871ab5790>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:20.195701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:20.198218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:20.199162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:20.200826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:20.207787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ffe77d25-a2e5-4d77-b642-c1a58475d000 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f3871aebe50>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:20.216037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-a6548041-fb99-4fae-8fe7-589490aa1256 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] HTTP exception thrown: Volume tempest-invalid-12339110 could not be found. Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6548041-fb99-4fae-8fe7-589490aa1256 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Request method failure captured: Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-12339110 HTTP/1.1 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCI5On_03z4e1FmJ95L5r4Gax-SrwDIRULkMXPneEVmTwKCH5ey8hE6hig59JO7qRlwtPTKOdupN7ORKbH9FnQxAHbkrgeFnG75V14dPJym6zE0bG14z-f7r3lsZ6Xc6pEIdUC0jWYxvgppAnaCiqdStPmYnCPDQlQLu57OxIzWv0B8 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:58:20.225038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: aba55f5cda1441249e414223ba8f0269 Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Volume tempest-invalid-12339110 could not be found. Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': 'tempest-invalid-12339110'} Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:58:20.226689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-12339110 could not be found. (HTTP 404) (Request-ID: req-1bf9ed3e-a663-4526-930a-94b5058a9f82) Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.227786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 09:58:20.229160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-12339110 could not be found. Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:58:20.230382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-12339110 could not be found. Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-12339110 could not be found. Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6548041-fb99-4fae-8fe7-589490aa1256 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Returning 404 to user: Volume tempest-invalid-12339110 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a6548041-fb99-4fae-8fe7-589490aa1256 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-12339110" status: 404 len: 97 microversion: 2.1 time: 0.554405 Jun 29 09:58:20.231925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1211 bytes} [Wed Jun 29 09:58:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-12339110 => generated 97 bytes in 555 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 29 09:58:20.252123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1d75919f-4cc6-4162-a1bc-d3a05215ed5f tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013303 Jun 29 09:58:20.255393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 4/5] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Jun 29 09:58:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 09:58:20.292461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2589460c-9438-47c9-9c04-cda62dec0bf4 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021307 Jun 29 09:58:20.297681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 5/6] 10.222.0.52 () {58 vars in 1136 bytes} [Wed Jun 29 09:58:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 09:58:20.311192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a29ddf76-1603-4633-a847-c868d62c3e29 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Calling method '.version_select at 0x7f387190c040>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:20.369860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-a29ddf76-1603-4633-a847-c868d62c3e29 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] HTTP exception thrown: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a29ddf76-1603-4633-a847-c868d62c3e29 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Request method failure captured: Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/os-volumes/d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 HTTP/1.1 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCI5On_03z4e1FmJ95L5r4Gax-SrwDIRULkMXPneEVmTwKCH5ey8hE6hig59JO7qRlwtPTKOdupN7ORKbH9FnQxAHbkrgeFnG75V14dPJym6zE0bG14z-f7r3lsZ6Xc6pEIdUC0jWYxvgppAnaCiqdStPmYnCPDQlQLu57OxIzWv0B8 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:58:20.372026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: aba55f5cda1441249e414223ba8f0269 Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': 'd11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9'} Jun 29 09:58:20.373483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. (HTTP 404) (Request-ID: req-d0939aba-3021-4215-b733-60f2fe045f9a) Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.374420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 09:58:20.375557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 09:58:20.376787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a29ddf76-1603-4633-a847-c868d62c3e29 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Returning 404 to user: Volume d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:58:20.377961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a29ddf76-1603-4633-a847-c868d62c3e29 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9" status: 404 len: 109 microversion: 2.1 time: 0.073834 Jun 29 09:58:20.380255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 6/7] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 09:58:20 2022] DELETE /compute/v2.1/os-volumes/d11e9ff0-c29c-4687-b3cd-f3b4f2ec29c9 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 09:58:20.388288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c513b589-0628-4022-b07b-95c18d9672b5 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Calling method '.version_select at 0x7f387190cdc0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:20.443859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c513b589-0628-4022-b07b-95c18d9672b5 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] HTTP exception thrown: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c513b589-0628-4022-b07b-95c18d9672b5 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Request method failure captured: Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/os-volumes/6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 HTTP/1.1 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCI5On_03z4e1FmJ95L5r4Gax-SrwDIRULkMXPneEVmTwKCH5ey8hE6hig59JO7qRlwtPTKOdupN7ORKbH9FnQxAHbkrgeFnG75V14dPJym6zE0bG14z-f7r3lsZ6Xc6pEIdUC0jWYxvgppAnaCiqdStPmYnCPDQlQLu57OxIzWv0B8 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:58:20.446273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d195d5e7f60544b48e25f0bedbbe8731"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: d195d5e7f60544b48e25f0bedbbe8731 Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-31631630 Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: aba55f5cda1441249e414223ba8f0269 Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-31631630-project Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '6829dcbf-3d3c-4d91-b7e5-9d54766c3a76'} Jun 29 09:58:20.447909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. (HTTP 404) (Request-ID: req-bcfe1f63-cd51-4bcf-8d96-d54b624ad8f6) Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.448679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 09:58:20.449853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 09:58:20.451019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c513b589-0628-4022-b07b-95c18d9672b5 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] Returning 404 to user: Volume 6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c513b589-0628-4022-b07b-95c18d9672b5 tempest-VolumesNegativeTest-31631630 tempest-VolumesNegativeTest-31631630-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6829dcbf-3d3c-4d91-b7e5-9d54766c3a76" status: 404 len: 109 microversion: 2.1 time: 0.067138 Jun 29 09:58:20.452196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 7/8] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 09:58:20 2022] GET /compute/v2.1/os-volumes/6829dcbf-3d3c-4d91-b7e5-9d54766c3a76 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 09:58:21.427074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ffe77d25-a2e5-4d77-b642-c1a58475d000 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6b360e7e-7484-43b7-81e2-ace006d242e8" status: 200 len: 351 microversion: 2.1 time: 1.232320 Jun 29 09:58:21.428030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 2/9] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 09:58:20 2022] GET /compute/v2.1/os-volumes/6b360e7e-7484-43b7-81e2-ace006d242e8 => generated 351 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:58:25.731900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2c722055-776b-4a4f-88e3-b41e0c6e7e36 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387190c5e0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:26.018536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2c722055-776b-4a4f-88e3-b41e0c6e7e36 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3cde3aa8-7e8f-4ab6-9610-8b9cefb6e578" status: 200 len: 350 microversion: 2.1 time: 0.290482 Jun 29 09:58:26.025033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 8/10] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 09:58:25 2022] GET /compute/v2.1/os-volumes/3cde3aa8-7e8f-4ab6-9610-8b9cefb6e578 => generated 350 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:58:28.051150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-25dbafa4-45c0-4bf8-b652-9d177ec1eb11 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387197d790>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:28.178456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-25dbafa4-45c0-4bf8-b652-9d177ec1eb11 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/570e2127-f46e-427f-a59a-273f2ef6c807" status: 200 len: 351 microversion: 2.1 time: 0.132901 Jun 29 09:58:28.191976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 3/11] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 09:58:28 2022] GET /compute/v2.1/os-volumes/570e2127-f46e-427f-a59a-273f2ef6c807 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:58:28.193443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-427db682-0b0b-4cda-a92c-d14571af792e tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f3871ab53a0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:28.413156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-427db682-0b0b-4cda-a92c-d14571af792e tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.224295 Jun 29 09:58:28.426272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a8226d1-65fa-487f-aa4c-005524a499a2 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387197ddc0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:28.426878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 9/12] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Jun 29 09:58:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:28.610710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a8226d1-65fa-487f-aa4c-005524a499a2 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.186354 Jun 29 09:58:28.611959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 4/13] 10.222.0.52 () {58 vars in 1148 bytes} [Wed Jun 29 09:58:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:58:28.626928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4cf720ad-502e-483f-89b8-cc7e39745948 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387190cee0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:28.937148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4cf720ad-502e-483f-89b8-cc7e39745948 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.316242 Jun 29 09:58:28.945559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 10/14] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Jun 29 09:58:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:28.951548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1b58eaf2-22ae-4565-8fa3-2177af16cc1e tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387190c9d0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:29.163629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1b58eaf2-22ae-4565-8fa3-2177af16cc1e tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.216685 Jun 29 09:58:29.165170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 11/15] 10.222.0.52 () {58 vars in 1166 bytes} [Wed Jun 29 09:58:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:58:29.179564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-73335ec4-0e32-4082-8342-392f31b1c435 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387191b280>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:29.380398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-73335ec4-0e32-4082-8342-392f31b1c435 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.205743 Jun 29 09:58:29.389938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 12/16] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Jun 29 09:58:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:58:29.395967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8f4b0d9-99d7-4757-8968-e7ec1a53161e tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f3871961ca0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:29.608185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-74a075e3-9641-49c1-a052-940144cf9010 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: .version_select at 0x7f387197de50>, body: {"keypair": {"name": "tempest-keypair-286085950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvlPBYa8xTxI5v8dAWRXTt8A9NXEhvTBU9UlxVptFSQHPu6cdyxGMexG9N9veUzo/93Ph8o6yD43AxnXvtqLzdQ3jWmml2FJ1gpNnoHscSz+7M9VUISGJj38sdOveOL2g=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:29.620080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8f4b0d9-99d7-4757-8968-e7ec1a53161e tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.228821 Jun 29 09:58:29.627299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 13/17] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Jun 29 09:58:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:29.637951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0952b3d-e99d-4f15-a060-a7656dfee0e2 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387190c040>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:29.765211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-74a075e3-9641-49c1-a052-940144cf9010 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:29.784636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-74a075e3-9641-49c1-a052-940144cf9010 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:29.844986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0952b3d-e99d-4f15-a060-a7656dfee0e2 tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.211743 Jun 29 09:58:29.845600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 14/18] 10.222.0.52 () {58 vars in 1187 bytes} [Wed Jun 29 09:58:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:58:29.859033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72a39706-e399-4a70-b944-772715b96e2f tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] Calling method '.version_select at 0x7f387191b4c0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:29.908712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-74a075e3-9641-49c1-a052-940144cf9010 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.114258 Jun 29 09:58:29.910226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 5/19] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 09:58:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:58:30.117255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72a39706-e399-4a70-b944-772715b96e2f tempest-VolumesTestJSON-1070699615 tempest-VolumesTestJSON-1070699615-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.262047 Jun 29 09:58:30.117944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 15/20] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Jun 29 09:58:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:34.473300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-70544167", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "networks": [{"uuid": "e2090313-2d8a-40ac-969f-881a91ce3569"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:34.492866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e01fe10-7c58-45e4-a348-04f24dc4ca13 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'create', calling method: .version_select at 0x7f3871914550>, body: {"keypair": {"name": "tempest-keypair-1870743805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyyHajSr70fg80i6c+QONFPjx9GMte9BSzYqq2ShGXgWGiwcAmJpBjznk1IEbOvabecpg2XC3g8Bg6a+3BFAdiGLiwZ3KeiAs6Lyj2u4Z1l56enMg3JWhh6+ZtNB4bm0Q=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:34.514815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-5e01fe10-7c58-45e4-a348-04f24dc4ca13 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for project f57102c066054370a153fb18dc4bc428. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:34.522377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-5e01fe10-7c58-45e4-a348-04f24dc4ca13 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for user 7900ba750c5f4e9faa69baaed1fd95d7 and project f57102c066054370a153fb18dc4bc428. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:34.604160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e01fe10-7c58-45e4-a348-04f24dc4ca13 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.645417 Jun 29 09:58:34.605167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 6/21] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Jun 29 09:58:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 647 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 09:58:34.732926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] validate_networks() for [('e2090313-2d8a-40ac-969f-881a91ce3569', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:58:37.421484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:58:37.423082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:58:37.423709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:58:37.424324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:58:37.425728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:58:37.447211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:37.447795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:37.448707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:37.450024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:37.546735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Getting quotas for project e10f49f1727f4327be986e4f7e131200. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:37.571991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Getting quotas for user 57605be4d856407f9ac4828ee1fef041 and project e10f49f1727f4327be986e4f7e131200. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:37.606262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:58:37.611377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:58:37.648900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-820146284", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94e95166-d965-465b-aef9-2a22cc2e6ee9"}], "security_groups": [{"name": "tempest-securitygroup--507284153"}], "key_name": "tempest-keypair-1870743805", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:37.789273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40d4e612-192a-4807-a49a-c56715a99d7b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.427216 Jun 29 09:58:37.790722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 16/22] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 09:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 09:58:37.806485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb16c8b8-4eb2-414e-a1de-64c4e4f2dc3b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:37.809941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb16c8b8-4eb2-414e-a1de-64c4e4f2dc3b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:37.996952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] validate_networks() for [('94e95166-d965-465b-aef9-2a22cc2e6ee9', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:58:38.103618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb16c8b8-4eb2-414e-a1de-64c4e4f2dc3b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:38.157064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb16c8b8-4eb2-414e-a1de-64c4e4f2dc3b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1213 microversion: 2.1 time: 0.356644 Jun 29 09:58:38.159659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 17/23] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:37 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1213 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:38.178732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-960596209", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8656fd5-64f6-4a7e-ad73-3f1c4df65b17"}], "security_groups": [{"name": "tempest-securitygroup--692035283"}], "key_name": "tempest-keypair-286085950", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:38.513994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] validate_networks() for [('e8656fd5-64f6-4a7e-ad73-3f1c4df65b17', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:58:39.730358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:58:39.731038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:58:39.731432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:58:39.731888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:58:39.732582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:58:39.758217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:39.762011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:39.763305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:39.765025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:39.780933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:58:39.781477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:58:39.781834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:58:39.782253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:58:39.782723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:58:39.799198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:39.800119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:39.801291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:39.804767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:39.843694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:39.859242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:39.864716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for project f57102c066054370a153fb18dc4bc428. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:39.883884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for user 7900ba750c5f4e9faa69baaed1fd95d7 and project f57102c066054370a153fb18dc4bc428. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:39.928835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:58:39.937671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:58:39.951953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:58:39.969131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:58:40.025373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3253afb5-a031-4891-abaa-493ea115c527 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.863035 Jun 29 09:58:40.027039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 18/24] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 09:58:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 09:58:40.237607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ce8398b8-8620-470c-ad3e-5d3fd9f10f5c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.595310 Jun 29 09:58:40.238274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 7/25] 10.222.0.52 () {62 vars in 1187 bytes} [Wed Jun 29 09:58:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 09:58:40.262314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b99ff678-e1ae-4ee4-8c1d-d3db53989d2c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:40.268860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b99ff678-e1ae-4ee4-8c1d-d3db53989d2c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:40.656867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b99ff678-e1ae-4ee4-8c1d-d3db53989d2c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:40.678262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1874646668", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:40.724439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b99ff678-e1ae-4ee4-8c1d-d3db53989d2c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1213 microversion: 2.1 time: 0.472694 Jun 29 09:58:40.738814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 8/26] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:40 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1213 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:40.753270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e90c92ec-b173-4404-895d-fd99ea50025d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:40.756786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e90c92ec-b173-4404-895d-fd99ea50025d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:40.900703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] validate_networks() for [('e3cd4382-18e9-435d-813a-72491e1c14a5', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:58:40.931541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e90c92ec-b173-4404-895d-fd99ea50025d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:40.943558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e90c92ec-b173-4404-895d-fd99ea50025d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1240 microversion: 2.1 time: 0.203024 Jun 29 09:58:40.945132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 9/27] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:40 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1240 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:40.952842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1612e5cf-660f-4e39-9078-864f7fcfa7bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:40.953612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1612e5cf-660f-4e39-9078-864f7fcfa7bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:41.147368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1612e5cf-660f-4e39-9078-864f7fcfa7bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:41.167620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1612e5cf-660f-4e39-9078-864f7fcfa7bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:41.184734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1612e5cf-660f-4e39-9078-864f7fcfa7bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:41.186214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1612e5cf-660f-4e39-9078-864f7fcfa7bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1281 microversion: 2.20 time: 0.239896 Jun 29 09:58:41.193619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 10/28] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:41.747590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:41.748511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:41.758811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:41.766514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:41.767986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:41.770272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:42.110007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:42.132129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dda4b028-3054-4e46-8e0d-cd510cd7be6d tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1209 microversion: 2.1 time: 0.391762 Jun 29 09:58:42.135081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 11/29] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:41 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1209 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:42.154966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6a676984-11fb-450e-843c-bfe3d5811292 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:42.159328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6a676984-11fb-450e-843c-bfe3d5811292 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:42.333419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:58:42.334540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:58:42.335192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:58:42.335759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:58:42.336492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:58:42.349273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6a676984-11fb-450e-843c-bfe3d5811292 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:42.360286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6a676984-11fb-450e-843c-bfe3d5811292 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1240 microversion: 2.1 time: 0.222615 Jun 29 09:58:42.364105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 12/30] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:42 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1240 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:42.377997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:42.378874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:42.387148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:42.389034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:42.390126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:42.392328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:42.395889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:42.397752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:42.401073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:42.404871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:42.474435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for project c695a228acc84e93baf309bec5e489c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:42.496119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for user 63ba0760d13e4bbda0650de803ef46ea and project c695a228acc84e93baf309bec5e489c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:42.542980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:58:42.555680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:58:42.739058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c68da608-2ce0-4b2d-b844-5b71697d91a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.701805 Jun 29 09:58:42.744216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 19/31] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 09:58:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 09:58:42.771020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1c0511f-50e8-41db-969f-5e6abc0bb85e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:42.771331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:42.774994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1c0511f-50e8-41db-969f-5e6abc0bb85e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:42.794890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:42.796540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:42.804631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9697adfa-0249-4523-a58b-c500410fcc14 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1277 microversion: 2.20 time: 0.436567 Jun 29 09:58:42.813636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 13/32] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1277 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:42.895717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1c0511f-50e8-41db-969f-5e6abc0bb85e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:42.904499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1c0511f-50e8-41db-969f-5e6abc0bb85e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1222 microversion: 2.1 time: 0.152565 Jun 29 09:58:42.925015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 20/33] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:42 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:43.152058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:43.152688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:43.170202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:43.170969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:43.173296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:43.175038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:43.259567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1550332193", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:58:43.331396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:43.340986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d51e16e2-8575-45bc-b83d-6964a6f320bf tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1265 microversion: 2.1 time: 0.192208 Jun 29 09:58:43.350734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 14/34] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:43 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:43.384479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:43.385055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:43.393745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] validate_networks() for [('e3cd4382-18e9-435d-813a-72491e1c14a5', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:58:43.397713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:43.399814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:43.401272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:43.401774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:43.576338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:43.596157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-af77ebf5-3b00-4d6e-836e-7ecc497d29f4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1244 microversion: 2.1 time: 0.217850 Jun 29 09:58:43.597146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 15/35] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:43 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1244 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:43.825786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:43.826912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:43.837250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:43.838476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:43.840629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:43.841272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.025242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:44.041106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:44.051563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:44.053036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9989142c-6364-4293-b623-d6bd428b841b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1277 microversion: 2.20 time: 0.231878 Jun 29 09:58:44.054647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 16/36] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:58:44.195145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:58:44.195568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:58:44.196421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:58:44.197059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:58:44.197628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:58:44.225360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:44.225778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.226761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:44.227477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.264186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for project c695a228acc84e93baf309bec5e489c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:58:44.272782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for user 63ba0760d13e4bbda0650de803ef46ea and project c695a228acc84e93baf309bec5e489c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:58:44.302953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:58:44.305273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:58:44.358406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:44.359149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:44.367750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:44.368240 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.368991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:44.369436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.375044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02011599-7c62-4b2a-8154-9ca437413015 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.119853 Jun 29 09:58:44.381803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 21/37] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 09:58:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 09:58:44.387837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b969a160-8ca4-4a61-b04d-da2c859b8afb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:44.389248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b969a160-8ca4-4a61-b04d-da2c859b8afb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:44.486186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b969a160-8ca4-4a61-b04d-da2c859b8afb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:44.499568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b969a160-8ca4-4a61-b04d-da2c859b8afb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1222 microversion: 2.1 time: 0.116239 Jun 29 09:58:44.500241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 22/38] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:44 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:44.615833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:44.616818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:44.628551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:44.629864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.633108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:44.635771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:44.713782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:44.737105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-014c1b17-75f0-43c7-85db-74bfbdea7987 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1265 microversion: 2.1 time: 0.382602 Jun 29 09:58:44.746660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 17/39] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:44 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:44.813881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:44.832120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66f687b3-b6cc-40fe-a92e-360d0fc75eb7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1244 microversion: 2.1 time: 0.222488 Jun 29 09:58:44.833113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 23/40] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:44 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1244 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:45.070199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:45.071091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:45.077867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.078323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.079189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.079625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.269346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:45.282798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:45.288377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:45.294853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-401931e3-02cb-45da-b1d7-a3abc3286ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1333 microversion: 2.20 time: 0.224737 Jun 29 09:58:45.295858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 18/41] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:45.518431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:45.520014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:45.529631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.530337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.531298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.531917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.621293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:45.635518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-825f4689-cd76-4305-9a79-607acbe0d1a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1226 microversion: 2.1 time: 0.121587 Jun 29 09:58:45.636284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 24/42] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:45 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:45.756553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:45.758783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:45.776926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.777653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.778707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.781259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.858965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:45.861507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:45.880158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.889033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:45.893304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:45.895236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:46.016880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:46.029865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa976429-b8dc-409c-82fa-b1c3984679e6 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1273 microversion: 2.1 time: 0.279076 Jun 29 09:58:46.031041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 19/43] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:45 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:46.081316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:46.092948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-680117cc-0020-4437-a06c-dd1c7bb336a3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1292 microversion: 2.1 time: 0.246850 Jun 29 09:58:46.103052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 25/44] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:45 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1292 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:46.319055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:46.319732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:46.326137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:46.332748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:46.339277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:46.342303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:46.483912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:46.499567 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:46.503972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:46.531172 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-119637c1-0b2f-4ffa-af9e-4bbf6b9c16be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1351 microversion: 2.20 time: 0.195648 Jun 29 09:58:46.532068 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 20/45] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1351 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:46.657026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:46.668819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:46.685331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:46.687741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:46.690700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:46.692012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:46.884974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:46.898291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-001450d4-e56a-492e-9e5d-d643cbad209d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1274 microversion: 2.1 time: 0.244249 Jun 29 09:58:46.899734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 26/46] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:46 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:47.049920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:47.050759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:47.066945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:47.067480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:47.068441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:47.083952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:47.116839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:47.121074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:47.150181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:47.151476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:47.158906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:47.165008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:47.686890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:47.702837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e711b2d5-3ff8-4ab9-8d03-e1488e3cfff8 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1271 microversion: 2.1 time: 0.657084 Jun 29 09:58:47.710409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:47 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1271 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:47.732964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:47.734478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:47.753054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:47.755131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:47.758338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:47.759037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:47.901133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:47.912569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:47.927062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:47.938058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-170278c7-431e-4252-bb86-8af02585fc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1339 microversion: 2.20 time: 0.221709 Jun 29 09:58:47.938913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 22/48] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:47.960993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:47.965301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:47.993302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:48.003165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:48.007755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:48.019858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:48.564138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:48.579993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-36059075-d95e-477a-a6b5-adbad8fd315d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1280 microversion: 2.1 time: 0.626236 Jun 29 09:58:48.582062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 23/49] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:47 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1280 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:48.606259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:48.626552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-105146ec-aaa0-4f37-a918-5ccc61d44f88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1298 microversion: 2.1 time: 1.516090 Jun 29 09:58:48.630441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 27/50] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:47 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1298 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:48.733497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:48.735561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:48.762886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:48.772443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:48.773597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:48.776350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:48.959414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:48.960382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:48.979972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:48.987855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:48.989086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:48.993838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:49.227546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:49.239181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-71df6964-a24f-433f-9629-16227d2534db tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.512095 Jun 29 09:58:49.240121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 24/51] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:48 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:49.600304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:49.601020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:49.620020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:49.621554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:49.623855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:49.626514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:49.733322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:49.743765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:49.753794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:49.756041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bf621244-f47b-459b-8d44-04c12411b0cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.801746 Jun 29 09:58:49.757075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 28/52] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:58:49.782014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:49.782702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:49.786004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:49.799690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ee0d1dc4-ab80-40a8-825c-6219aee63b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1280 microversion: 2.1 time: 0.205133 Jun 29 09:58:49.803694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 25/53] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:49 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:49.811045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:49.811724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:49.812976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:49.813773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.074773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:50.084932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2251e1b-e3a2-49ef-a4ec-6eda1978cb8d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.326212 Jun 29 09:58:50.085699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 29/54] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:49 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:50.257784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:50.258260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:50.261591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:50.272226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:50.272876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.274101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:50.275788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.615670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:50.632798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bbf28c67-6223-48e8-9a55-efc93983200b tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.378907 Jun 29 09:58:50.633624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 26/55] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:50 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:50.778767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:50.780238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:50.789509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:50.790228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.791168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:50.791896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.818624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:50.819408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:50.822633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:50.829596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:50.830265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.831273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:50.832252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:50.940113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:50.948615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:50.950516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:50.951767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e5290bf-fe67-4df6-9657-fc964c37b2f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.180685 Jun 29 09:58:50.952358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 30/56] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:50.979443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:50.987086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-108622bc-7598-4004-bc96-b5fb9aacad80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.173492 Jun 29 09:58:50.988580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 27/57] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:50 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:51.103030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:51.103567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:51.110288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:51.110768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:51.111525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:51.111970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:51.247999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:51.255672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b40c5985-071f-424f-8205-7fca8686cb7b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.156679 Jun 29 09:58:51.256977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 31/58] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:51 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:51.659735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:51.660287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:51.667424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:51.667882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:51.668638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:51.669060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:51.673035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:51.927406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:51.936984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e574315b-7737-4fac-804f-7a12348ab177 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.281376 Jun 29 09:58:51.940030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:51 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:51.982950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:51.982950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:51.982950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:51.982950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:51.983673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:51.983673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:52.009307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:52.010147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:52.017699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:52.018622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:52.019782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:52.020456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:52.180870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:52.191984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:52.194023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:52.195503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1335537b-9994-48ce-b0db-2d27edff53f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.229917 Jun 29 09:58:52.196700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 32/60] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:52.213076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:52.220935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9ee2ee12-d130-47ba-af34-f63178543172 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.220844 Jun 29 09:58:52.221782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 29/61] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:51 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:52.273991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:52.274701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:52.278083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:52.283825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:52.284293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:52.285083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:52.285523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:52.435748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:52.443549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06758089-f52a-4c6c-bea7-069ef1a8c565 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.174155 Jun 29 09:58:52.444121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 33/62] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:52 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:52.955992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:52.956810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:52.958769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=22 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:52.976046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:52.976499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:52.977465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:52.977897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.168970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:53.178181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-83f33634-2691-4ce4-a056-f34bf5eb19d7 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.226115 Jun 29 09:58:53.178636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 30/63] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:52 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:53.215976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:53.216589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:53.223204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:53.223644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.224416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:53.224854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.237256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:53.237867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:53.244859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:53.245016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.245666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:53.246089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.389107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:53.401671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:53.403347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:53.404640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a21dc357-f11b-44d7-a5e8-9a1361492206 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.193063 Jun 29 09:58:53.405670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 34/64] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:53.429207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:53.436976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dae6ff44-47f2-4f25-9485-a2f5dca3e6a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.203610 Jun 29 09:58:53.437544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 31/65] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:53 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:53.460695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:53.461661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:53.469167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:53.469621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.470461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:53.470925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:53.613916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:53.621466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6cf075fb-19a6-4d32-8de1-27e1d9e4d1b2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.164895 Jun 29 09:58:53.622030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 35/66] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:53 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:54.196744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:54.198099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:54.207745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.208153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.208936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.209373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.348804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:54.356697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-156c24de-a8d8-4557-9fa6-0a9e4d092310 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.165207 Jun 29 09:58:54.357306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 32/67] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:54 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:54.429631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:54.430197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:54.432026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:54.437598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.438141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.438844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.439260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.453943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:54.455247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:54.463302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.464259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.465396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.466032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.490870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:54.621135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:54.630372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:54.634037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:54.650268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48ff7ab0-df7d-4ade-bcc8-205191511d4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.224553 Jun 29 09:58:54.651092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 36/68] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:54.655037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:54.662377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:54.663279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:54.664727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-92d73769-e612-4362-8f48-97081fa68fe3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.214595 Jun 29 09:58:54.666811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:54 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:54.670220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.670705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.671647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:54.672229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:54.854982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:54.863087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70dc280b-1d7b-4bde-98fc-f6121ffc2fed tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.210649 Jun 29 09:58:54.863687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 37/70] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:54 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:55.373883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:55.374755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:55.381479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.381927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.382747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.383188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.537819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:55.551780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-79f4b5d0-e002-4e8a-a161-596537931a97 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.181843 Jun 29 09:58:55.553223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 34/71] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:55 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:55.673148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:55.674512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:55.682964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.683182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:55.683636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:55.685128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.686124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.686768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.691403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.692474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.693469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.694389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.697629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:58:55.875876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:55.885782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:55.887333 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:55.888473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f2cf4e3a-6555-4481-a065-b2739dddfc88 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.222984 Jun 29 09:58:55.899438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 38/72] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:55.899438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:55.899438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:55.904325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.904940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.906085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:55.906779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:55.980342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:55.989432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fe1c75cd-7e40-4b35-9c62-a1fda56c174f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.310276 Jun 29 09:58:55.989939 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 35/73] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:55 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:56.117033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:56.127021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5afdf472-867d-4153-b6f5-b1c0f2da025b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.236328 Jun 29 09:58:56.127829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 39/74] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:55 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:56.574705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:56.577658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:56.593233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:56.594319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:56.596020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:56.597975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:56.862258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:56.872117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d3247da1-42bc-4ac8-96b1-66dcdec44ee5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.303974 Jun 29 09:58:56.875256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 36/75] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:56 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:56.926599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:56.928902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:56.942927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:56.943799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:56.945012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:56.945755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:57.010203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:57.011178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:57.020108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:57.020541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:57.029782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:57.030238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:57.182544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:57.194279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:57.195955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:57.197480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ebf8f302-6bb1-4874-887d-f8f0e1291680 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.289862 Jun 29 09:58:57.208802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 40/76] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:57.217052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:57.218097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:57.228961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:57.229659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:57.232126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:57.233592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:57.301927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:57.313634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-73c93b4f-838b-4c52-8015-8108607dab70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.307654 Jun 29 09:58:57.315533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 37/77] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:57 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:57.545299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:57.557307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-daba4f57-40de-4e84-b541-eec4217cb37d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.346779 Jun 29 09:58:57.558984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 41/78] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:57 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:57.892835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:57.893549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:57.914828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:57.915288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:57.916081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:57.916831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.068541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:58.076402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8281ae34-341d-4c09-bf2e-b59f2045f172 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.187771 Jun 29 09:58:58.077097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 38/79] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:57 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:58.216072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:58.217501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:58.236072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:58.240154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.241600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:58.242215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.331360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:58.332296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:58.340052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:58.340876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.341862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:58.342489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.552148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:58.562724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-113421d2-f0c6-4f9c-9fa1-5c11070cd719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.235798 Jun 29 09:58:58.566960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 39/80] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:58 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:58:58.583831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:58.585244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:58.586047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:58.593439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:58.593649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:58.594814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.595010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:58.596074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:58.596783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7bbf15c7-ceb3-4773-9321-3a11bbdf93b4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.384833 Jun 29 09:58:58.597309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:58.607317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 42/81] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:58.777773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:58.787458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-31094d9f-8553-4426-9afc-d9c7e06c51ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.206800 Jun 29 09:58:58.789747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 40/82] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:58 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:59.098521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:59.099627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:59.108061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.108504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.109380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.109930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.284014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:59.294993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f0afe3e9-d4df-4956-86ea-20285f0e351e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.203877 Jun 29 09:58:59.296018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 43/83] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:59 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:59.587666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:59.588287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:59.594488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.594965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.595849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.596436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.619910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:59.620710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:59.632171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.632832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.633768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.634369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.806528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:59.810635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:59.817487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6fd7f9ac-7a9c-4465-88d2-3cfe08253938 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.232859 Jun 29 09:58:59.820348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 41/84] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:59 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:58:59.821558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:59.823486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:58:59.824779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b8a75ff-81d8-4153-9a77-a87525cf8b2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.214128 Jun 29 09:58:59.825768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 44/85] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:58:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:58:59.839799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:58:59.840410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:58:59.846952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.847627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:58:59.848582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:58:59.849126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:00.272299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:00.280829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4a794c9-1283-4fa1-ac2b-5a0e229c5bca tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.459179 Jun 29 09:59:00.281806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 42/86] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:58:59 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:00.312395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:00.313736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:00.320423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:00.320951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:00.321971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:00.322495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:00.759963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:00.770926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee9f8838-66f7-4418-b2f2-5dadbaa7bf89 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.462765 Jun 29 09:59:00.772101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 45/87] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:00 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:00.840751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:00.841575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:00.845621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:00.847044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:00.855928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:00.856382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:00.857104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:00.857522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:00.857849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:00.857990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:00.859148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:00.859741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:01.496881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:01.509929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e71db6b8-df6c-458d-aaa5-e60124087a1b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.677144 Jun 29 09:59:01.511145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 43/88] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:00 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:01.520681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:01.521552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:01.543205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:01.544757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:01.549436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:01.550343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:01.697295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:01.711544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:01.717709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:01.720136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-246697bb-a1c4-4e88-9e39-5ba9aba3e99c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.880463 Jun 29 09:59:01.722998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 46/89] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:01.790210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:01.790848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:01.803385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:01.805012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:01.808213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:01.810690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:01.924386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:01.930743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:01.940505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7d9a00a4-a728-47d0-aff7-6a1c8d72a702 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.427845 Jun 29 09:59:01.941826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 44/90] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:01 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:02.431055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:02.441333 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9004ef34-81b0-45be-bbc2-76c8e460c890 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.655721 Jun 29 09:59:02.450225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 47/91] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:01 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:02.528215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:02.528843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:02.550048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:02.555978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:02.563344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:02.563799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:02.741056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:02.741776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:02.757562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:02.758122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:02.759391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:02.760061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:03.147766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:03.157964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-17f29a17-ad8c-4400-be8c-08eb96f87756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.634176 Jun 29 09:59:03.164139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 45/92] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:02 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:03.487235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:03.492467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-ae40d3b1-19f6-4eef-977b-8e0d5ab8adec req-66da950a-859b-4091-bb1b-45de3e24804f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bda5f73a-de16-48fa-b51d-1ad23f583de6", "tag": "063aad5d-365b-4b91-85a8-eb1ef8386318"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:03.516492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:03.526741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:03.533188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6138e7ab-6a19-4196-af20-057d3d23e0be tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.791262 Jun 29 09:59:03.544413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 48/93] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:59:03.547647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ae40d3b1-19f6-4eef-977b-8e0d5ab8adec req-66da950a-859b-4091-bb1b-45de3e24804f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:03.550284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ae40d3b1-19f6-4eef-977b-8e0d5ab8adec req-66da950a-859b-4091-bb1b-45de3e24804f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:03.556876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:03.559233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:03.570305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:03.571186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:03.572235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:03.573003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:03.619047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-ae40d3b1-19f6-4eef-977b-8e0d5ab8adec req-66da950a-859b-4091-bb1b-45de3e24804f service nova] Creating event network-changed:063aad5d-365b-4b91-85a8-eb1ef8386318 for instance bda5f73a-de16-48fa-b51d-1ad23f583de6 on hv-cinder-76810 Jun 29 09:59:03.619641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ae40d3b1-19f6-4eef-977b-8e0d5ab8adec req-66da950a-859b-4091-bb1b-45de3e24804f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117950) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 09:59:03.622346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:03.622828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:03.624086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:03.629549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:03.655141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.compute.rpcapi [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 09:59:03.656055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117950) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 09:59:03.700284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-596d1fc9-9f4f-4d66-8880-b530fa3487d2 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.534560 Jun 29 09:59:03.701182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 46/94] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:03.994038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-31397fe6-fbd0-4c3a-be1e-2fed261aa2c4 req-bb009753-02d1-4ca8-bcd4-16c5189fde4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:04.015623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-31397fe6-fbd0-4c3a-be1e-2fed261aa2c4 req-bb009753-02d1-4ca8-bcd4-16c5189fde4a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.016065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-31397fe6-fbd0-4c3a-be1e-2fed261aa2c4 req-bb009753-02d1-4ca8-bcd4-16c5189fde4a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.028113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-31397fe6-fbd0-4c3a-be1e-2fed261aa2c4 req-bb009753-02d1-4ca8-bcd4-16c5189fde4a service nova] Creating event network-changed:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 09:59:04.034750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-31397fe6-fbd0-4c3a-be1e-2fed261aa2c4 req-bb009753-02d1-4ca8-bcd4-16c5189fde4a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331902 Jun 29 09:59:04.035950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 47/95] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:04.042772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:04.043798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:04.053562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.054208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.055179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.055740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.200294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:04.213766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ff2f314-900c-4807-a02a-401dfff98dc9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.673321 Jun 29 09:59:04.215608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 49/96] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:03 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:04.222526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:04.224643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:04.242065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.242838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.244516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.245065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.294725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:04.307285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c3feb8a5-15af-47e6-b466-5dd14d0b8c55 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.269945 Jun 29 09:59:04.308416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 48/97] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:04 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:04.432252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:04.442823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66e542f0-440c-4f19-b9d4-9bf8c29aad41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.225468 Jun 29 09:59:04.443784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 50/98] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:04 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:04.551550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:04.552171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:04.558869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.559315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.560126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:04.560561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:04.718112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:04.729029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:04.730542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:04.731694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5d3d43c8-442c-4ecc-82e8-27626b26cf2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.184589 Jun 29 09:59:04.732246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 49/99] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:05.232665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:05.234135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:05.243283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.244145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.245122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.246243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.324336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:05.325660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:05.334417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.335257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.337755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.338708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.418115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:05.430933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6e6d133-dfc2-4df3-96c3-98fc0e22ebb3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.200597 Jun 29 09:59:05.431831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 51/100] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:05 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:05.465437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:05.466761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:05.476033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.477027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.478056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.479037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.512919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:05.523082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c7817cd6-9f62-4dd4-aaf4-4099a5cee19e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.202970 Jun 29 09:59:05.524028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 50/101] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:05 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:05.636700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:05.645968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-86421476-da06-4980-849b-ddf4b18eb11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.189168 Jun 29 09:59:05.656155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 52/102] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:05 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:05.740109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-ba7d5451-9810-4833-a468-9f8c289e92dc req-27346652-d3dd-4dad-b0b0-5033034a8587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddf1295-57be-4e50-8403-e2ed8353c18c", "tag": "b0721056-6a1f-408b-a2d5-9b3182abad69"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:05.749728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:05.750350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:05.755830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ba7d5451-9810-4833-a468-9f8c289e92dc req-27346652-d3dd-4dad-b0b0-5033034a8587 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.759206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-ba7d5451-9810-4833-a468-9f8c289e92dc req-27346652-d3dd-4dad-b0b0-5033034a8587 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.773476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.774070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.774915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:05.775357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:05.782064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-ba7d5451-9810-4833-a468-9f8c289e92dc req-27346652-d3dd-4dad-b0b0-5033034a8587 service nova] Creating event network-changed:b0721056-6a1f-408b-a2d5-9b3182abad69 for instance 1ddf1295-57be-4e50-8403-e2ed8353c18c on hv-cinder-76810 Jun 29 09:59:05.792417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-ba7d5451-9810-4833-a468-9f8c289e92dc req-27346652-d3dd-4dad-b0b0-5033034a8587 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057198 Jun 29 09:59:05.793036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 51/103] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:05.940494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:05.949669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:05.952495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:05.954022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-67357783-b34d-4bd6-8dda-0df9e71c14c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.208339 Jun 29 09:59:05.954994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 53/104] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:59:06.064857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-b17fe5f4-88e8-4d60-bca0-cc17346919a6 req-c3901b6a-e1e7-46f9-902f-d137a716008a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3babafc-afb4-4eae-b574-eb9f6ed15d49", "tag": "9a0b7777-bdfd-4168-abd4-ad7018402896"}, {"name": "network-changed", "server_uuid": "1120efe8-bc65-4df7-88b6-91c5a05e0df6", "tag": "fb530b84-13d0-48d3-bd34-ebc3797cfd0b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:06.074873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b17fe5f4-88e8-4d60-bca0-cc17346919a6 req-c3901b6a-e1e7-46f9-902f-d137a716008a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.075432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b17fe5f4-88e8-4d60-bca0-cc17346919a6 req-c3901b6a-e1e7-46f9-902f-d137a716008a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.091317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-b17fe5f4-88e8-4d60-bca0-cc17346919a6 req-c3901b6a-e1e7-46f9-902f-d137a716008a service nova] Creating event network-changed:9a0b7777-bdfd-4168-abd4-ad7018402896 for instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 on hv-cinder-76810 Jun 29 09:59:06.091913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-b17fe5f4-88e8-4d60-bca0-cc17346919a6 req-c3901b6a-e1e7-46f9-902f-d137a716008a service nova] Creating event network-changed:fb530b84-13d0-48d3-bd34-ebc3797cfd0b for instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 on hv-cinder-76810 Jun 29 09:59:06.098351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-b17fe5f4-88e8-4d60-bca0-cc17346919a6 req-c3901b6a-e1e7-46f9-902f-d137a716008a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040026 Jun 29 09:59:06.099074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 52/105] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:06.449564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:06.451066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:06.458439 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.459300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.460400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.460882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.540883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:06.541583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:06.547998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.548702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.549763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.550196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.768527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:06.778741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-494ca0d8-878a-426e-8b0e-2b391dc26fbc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.241878 Jun 29 09:59:06.779512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 53/106] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:06 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:06.784913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:06.785738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:06.794417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.795149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.796100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.796681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.810985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:06.815994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:06.823398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-58dc1cf7-b194-44ff-9752-c08ab5015f4d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.378584 Jun 29 09:59:06.824200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 54/107] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:06 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:06.974094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:06.974936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:06.983146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:06.992191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff33a0e5-e86d-4b55-9052-2e89144e29bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.211437 Jun 29 09:59:06.992753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:06.993412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:06.994375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:07.006190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 54/108] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:06 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:07.007719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:07.167141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:07.175521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:07.177157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:07.178550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9edab071-8f0e-4d4e-b4dc-c05dfce08077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.209643 Jun 29 09:59:07.179171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 55/109] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:59:07.797291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:07.798498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:07.808385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:07.809062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:07.810303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:07.811628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:07.841606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:07.842212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:07.848318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:07.848965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:07.849733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:07.850161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:07.956805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:07.966499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4cf9d9e3-6b7f-48bf-b3ce-7065b8536c1e tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.174393 Jun 29 09:59:07.967150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 55/110] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:07 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:07.998650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:08.010029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd0dfaec-1b87-42be-822e-8f82351f08de tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.171798 Jun 29 09:59:08.011398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 56/111] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:07 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:08.013566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:08.014610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:08.022751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:08.022751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:08.023223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:08.023657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:08.172435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:08.179970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1bfed1d-f7dc-4496-ac49-84650b6e551c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.173665 Jun 29 09:59:08.180554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 56/112] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:08 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:08.197244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:08.198297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:08.205500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:08.205642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:08.206304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:08.206849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:08.335635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:08.344512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:08.346177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:08.347350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4e0f30e-dc9a-4c9f-8510-804c14a3387f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.154675 Jun 29 09:59:08.347941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 57/113] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:08.983646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:08.984269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:08.990784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:08.991324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:08.992112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:08.992544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.031429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:09.032042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:09.041991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:09.042715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.043642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:09.044211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.159054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:09.166848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7803964-445e-417c-9824-3b4ad6053edb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.187020 Jun 29 09:59:09.167440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 57/114] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:08 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:09.198505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:09.199286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:09.205859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:09.206309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.207432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:09.207877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.217151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:09.226868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-549cb37f-1b47-4ba4-96d5-decad00ead20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.199495 Jun 29 09:59:09.227682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 58/115] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:09 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:09.364621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:09.366349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:09.367095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:09.372574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-18964fe5-ccfb-4601-9f6d-e48aaa60b712 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.178430 Jun 29 09:59:09.373955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:09.374454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.375305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:09.375786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:09.382735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 58/116] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:09 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:09.526068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:09.534674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:09.536258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:09.537478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8c454db-6af7-4c80-8132-fd46f12d116d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.175860 Jun 29 09:59:09.538039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 59/117] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:10.185421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:10.187316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:10.196259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.196259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.196259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.196719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.243759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:10.244363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:10.254114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.254893 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.255695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.256161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.491243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:10.492231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:10.502346 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf308448-57af-4501-b0ff-23796db79ef1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.262643 Jun 29 09:59:10.503340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 60/118] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:10 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:10.512077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:10.512703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:10.513558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1815d4b2-d344-418a-afa4-fd508ea30960 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.332629 Jun 29 09:59:10.514225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 59/119] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:10 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:10.525544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.525998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.526818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.527553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.554615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:10.555234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:10.562354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.567699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.568883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:10.569562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:10.797783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:10.808050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:10.809869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:10.810230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:10.811377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1da97f38-094f-4833-a4e1-699b4fa76437 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.260577 Jun 29 09:59:10.812250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 60/120] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:10.818456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ba156e2-a3ef-4241-ab73-cebe6923a59e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.313866 Jun 29 09:59:10.822617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 61/121] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:10 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:11.519921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:11.521073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:11.531309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:11.532422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:11.544321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:11.544983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:11.545932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:11.546534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:11.546965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:11.549311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:11.551978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:11.552523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:12.062962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:12.072672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ce89bfb-df31-4ef9-8478-df6c3f202e1c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.545676 Jun 29 09:59:12.083808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 62/122] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:11 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:12.090796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:12.092268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:12.101484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:12.101934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:12.102963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:12.103820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:12.158325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:12.172256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-de364371-b8d8-4c9a-8d9e-b131f207df73 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.656662 Jun 29 09:59:12.172965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 61/123] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:11 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:12.198906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:12.200400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:12.229657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:12.230610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:12.231620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:12.233688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:12.336374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:12.347911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:12.350001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:12.352016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07a800df-5da8-4764-9761-54f087d65d1c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.266501 Jun 29 09:59:12.362373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 63/124] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:12.433799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:12.442365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-10088f69-cfaf-43ff-80a0-f915ff9dc25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.266305 Jun 29 09:59:12.443113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 62/125] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:12 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:13.089690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:13.090304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:13.101668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.102083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.102891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.103320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.189788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:13.191197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:13.201483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.203061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.204241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.205871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.546336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:13.556628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:13.560714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:13.569194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e5c1def2-0993-4d63-a204-26df075e33cb tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.483555 Jun 29 09:59:13.571636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6955c3bd-68cd-4c96-bca8-4b460135c371 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.385110 Jun 29 09:59:13.582383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 64/127] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:13 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:13.584483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 63/127] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:13 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:13.590092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:13.593836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:13.594601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:13.595584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:13.608967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.609764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.610294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.610914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.612822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.613238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:13.613751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.614329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:13.655981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:13.997563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:14.015013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-371e493c-ba9b-46d4-8e13-567af96632d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.429189 Jun 29 09:59:14.016145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 64/128] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:13 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:14.229914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:14.242929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:14.245082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:14.246234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4999a9f0-4fc6-47cc-9bce-ec4c27bf1135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.662530 Jun 29 09:59:14.247065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 65/129] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:14.589373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:14.589990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:14.599728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:14.600596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:14.601678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:14.602364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:14.603632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:14.604499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:14.612356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:14.615820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:14.618826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:14.619292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:14.835052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:14.851584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9e6ce1e8-09c5-43d4-9832-04d6ef4e48f3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.266376 Jun 29 09:59:14.853916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 65/130] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:14 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:15.032939 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:15.033827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:15.065104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.065775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.066798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.067459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.152718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:15.173044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-741f7fae-fe4d-4b2e-b49c-de65c85bf6f3 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.575973 Jun 29 09:59:15.179101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 66/131] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:14 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:15.267069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:15.268757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:15.287721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.288692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.295841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.299341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.422973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:15.438047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d5a24328-5420-4b74-ab16-a58189a2172f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.409447 Jun 29 09:59:15.440618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 66/132] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:15 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:15.613487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-e65848e5-1cad-4cf4-b1f2-df3f7ddf6a50 req-6f404420-7473-4a6a-af01-8a3b41757207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda5f73a-de16-48fa-b51d-1ad23f583de6", "name": "network-vif-plugged", "status": "completed", "tag": "063aad5d-365b-4b91-85a8-eb1ef8386318"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:15.631474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e65848e5-1cad-4cf4-b1f2-df3f7ddf6a50 req-6f404420-7473-4a6a-af01-8a3b41757207 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.633055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e65848e5-1cad-4cf4-b1f2-df3f7ddf6a50 req-6f404420-7473-4a6a-af01-8a3b41757207 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.662213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-e65848e5-1cad-4cf4-b1f2-df3f7ddf6a50 req-6f404420-7473-4a6a-af01-8a3b41757207 service nova] Creating event network-vif-plugged:063aad5d-365b-4b91-85a8-eb1ef8386318 for instance bda5f73a-de16-48fa-b51d-1ad23f583de6 on hv-cinder-76810 Jun 29 09:59:15.669367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-e65848e5-1cad-4cf4-b1f2-df3f7ddf6a50 req-6f404420-7473-4a6a-af01-8a3b41757207 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142589 Jun 29 09:59:15.669986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 67/133] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:15.870485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:15.878045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:15.880106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:15.888823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.891583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:15.892096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.893208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:15.893985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:15.895024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:15.896205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd9450e9-c8cf-4868-b9e1-f610587f9bf5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.635348 Jun 29 09:59:15.899573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 67/134] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:16.132197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:16.145381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-68d85bfb-8b3a-44b7-8aa5-75ec7cf3b149 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.279598 Jun 29 09:59:16.147808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 68/135] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:15 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:16.198858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:16.199873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:16.213226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:16.216661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:16.219571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:16.220510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:16.455728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:16.456999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:16.467953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:16.469216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:16.476367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:16.477300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:16.607341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:16.615930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-abe9b34e-88ac-4027-8f7f-c7481b50d337 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.424102 Jun 29 09:59:16.622182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 68/136] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:16 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:16.751383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:16.767355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-037ac68e-c3e1-4362-93ae-45acda1b3d96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.315254 Jun 29 09:59:16.768026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 69/137] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:16 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:16.923873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:16.924488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:16.931054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:16.931501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:16.932273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:16.932810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.092245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:17.101753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:17.103311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:17.104408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72d07adb-cecb-4b56-a365-3b3c32780467 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.189643 Jun 29 09:59:17.105202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 69/138] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:17.164240 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:17.164958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:17.171368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.172058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.172916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.173444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.324731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:17.334505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9451513-cf38-4fcf-998a-67d881c21f57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.174253 Jun 29 09:59:17.335321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 70/139] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:17 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:17.638978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:17.639634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:17.646470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.647044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.648030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.648647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.685619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-9590299c-c986-459c-9a3f-0e2619d9aa40 req-5e0b733c-8959-4081-afd5-c8dd9de92215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "name": "network-vif-plugged", "status": "completed", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:17.697989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-9590299c-c986-459c-9a3f-0e2619d9aa40 req-5e0b733c-8959-4081-afd5-c8dd9de92215 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.698681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-9590299c-c986-459c-9a3f-0e2619d9aa40 req-5e0b733c-8959-4081-afd5-c8dd9de92215 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.714350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-9590299c-c986-459c-9a3f-0e2619d9aa40 req-5e0b733c-8959-4081-afd5-c8dd9de92215 service nova] Creating event network-vif-plugged:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 09:59:17.722700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-9590299c-c986-459c-9a3f-0e2619d9aa40 req-5e0b733c-8959-4081-afd5-c8dd9de92215 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040440 Jun 29 09:59:17.728187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 71/140] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:17.785747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:17.786451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:17.793069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.793563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.803046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:17.803749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:17.808718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:17.817067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-461c0519-b42d-4b2e-9328-ea302f377747 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.181872 Jun 29 09:59:17.821735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 70/141] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:17 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:17.964560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:17.977832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4fd84336-e946-4317-96bc-dd000d512d45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.196856 Jun 29 09:59:17.978958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 72/142] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:17 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:18.124323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:18.125116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:18.132201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:18.132631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:18.133397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:18.133825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:18.154147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:18.285492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:18.298191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:18.299947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:18.301071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-696f5303-443e-4dab-977a-ebf45cde3d30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.181300 Jun 29 09:59:18.301609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 71/143] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 09:59:18.354360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:18.355406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:18.362986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:18.363436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:18.364204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:18.364640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:18.525229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:18.536647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fc9c4830-a6ff-4642-8459-1f538c178e1b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.188488 Jun 29 09:59:18.537217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 73/144] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:18 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:18.838739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:18.839338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:18.845932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:18.846508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:18.847328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:18.847759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:18.981996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:18.991472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b7ce51df-d66e-4292-8c58-448e0101ff67 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.156899 Jun 29 09:59:19.001490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 72/145] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:18 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:19.002043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:19.002043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:19.002966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:19.004760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:19.005685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:19.006131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:19.318024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:19.320429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:19.321091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:19.326278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fc7f9b8a-19ed-4fb0-921b-72ea289f5a0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.334388 Jun 29 09:59:19.327123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 74/146] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:18 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:19.327616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:19.328073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:19.328838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:19.329531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:19.480172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:19.493335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:19.495642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:19.497281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cefed682-71dc-4a7e-ba2c-39288645e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.180470 Jun 29 09:59:19.498051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 73/147] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:59:19.556053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:19.556561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:19.568739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:19.569185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:19.569972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:19.570387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:19.715071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:19.723506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6ef6ecff-2479-4d60-b529-af3d98ae3ed3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.173178 Jun 29 09:59:19.724105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 75/148] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:19 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:20.012476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:20.013089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:20.020846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.021280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.022058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.022477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.170155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:20.182754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8c2b8992-6fa0-4ea1-93d4-76fd60bc5187 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1313 microversion: 2.1 time: 0.176645 Jun 29 09:59:20.183354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 74/149] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:20 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:20.344362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:20.345263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:20.357090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.358285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.360198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.360198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.517998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:20.518774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:20.526763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.527610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.528784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.529513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.532106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:20.543715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-53e90d63-f2fd-43a2-aae6-6bd01e39cfc2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.203375 Jun 29 09:59:20.551625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 76/150] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:20 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:20.630056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-8a76aa67-c56b-42cc-a2c5-634ef7feb20e req-f5252191-cf27-4ca0-91ed-234dda0f0139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf1295-57be-4e50-8403-e2ed8353c18c", "name": "network-vif-plugged", "status": "completed", "tag": "b0721056-6a1f-408b-a2d5-9b3182abad69"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:20.633817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:20.639302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-8a76aa67-c56b-42cc-a2c5-634ef7feb20e req-f5252191-cf27-4ca0-91ed-234dda0f0139 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.640121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-8a76aa67-c56b-42cc-a2c5-634ef7feb20e req-f5252191-cf27-4ca0-91ed-234dda0f0139 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.656191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-8a76aa67-c56b-42cc-a2c5-634ef7feb20e req-f5252191-cf27-4ca0-91ed-234dda0f0139 service nova] Creating event network-vif-plugged:b0721056-6a1f-408b-a2d5-9b3182abad69 for instance 1ddf1295-57be-4e50-8403-e2ed8353c18c on hv-cinder-76810 Jun 29 09:59:20.664658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-8a76aa67-c56b-42cc-a2c5-634ef7feb20e req-f5252191-cf27-4ca0-91ed-234dda0f0139 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038015 Jun 29 09:59:20.668230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 77/151] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:20.703269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:20.715277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:20.716779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:20.718285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1d2eb046-a8ba-4233-bc41-a0aa703c7747 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1406 microversion: 2.20 time: 0.205037 Jun 29 09:59:20.719055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 75/152] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:59:20.740834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:20.741592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:20.751244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.751982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:20.753852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:20.754677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.017400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:21.036530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dc73f9e9-c0b9-45bd-b1c1-20d88263e453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.300151 Jun 29 09:59:21.038120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 78/153] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:20 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:21.200371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:21.201213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:21.211624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:21.217546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.219688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:21.220393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.421301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:21.432484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-41d78c20-f5c2-45a2-a26a-fe7ddbca52e5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1500 microversion: 2.1 time: 0.235764 Jun 29 09:59:21.433818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 76/154] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:21 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1500 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:21.561297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:21.561995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:21.573302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:21.573948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.575699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:21.575699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.737802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:21.739499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:21.751957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:21.758612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.760741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:21.761678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:21.770547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:21.781575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-233dbce5-6f1a-44d6-9b35-720003320b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.221427 Jun 29 09:59:21.782445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 79/155] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:21 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:22.021072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:22.030343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:22.032041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:22.033615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2207f922-5193-4d97-9436-234d85be8739 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1599 microversion: 2.20 time: 0.300443 Jun 29 09:59:22.034282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 77/156] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 09:59:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1599 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 09:59:22.059420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:22.060288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:22.060590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:22.061143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:22.068814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.069043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.069660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.069850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.070814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.071363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.071635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.072656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.203623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0b3515df-f13a-4d3c-867b-c8a6f0af6cb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.146956 Jun 29 09:59:22.204258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 80/157] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Jun 29 09:59:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 09:59:22.312419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:22.322387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c9f5259c-9159-44b0-ab20-26e09b1627e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1365 microversion: 2.1 time: 0.268697 Jun 29 09:59:22.323138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 78/158] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:22 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:22.718435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-d4f668a4-c804-4436-b293-e2370f82cf2d req-fdd86297-7238-426b-9e5d-36ec8ae156c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3babafc-afb4-4eae-b574-eb9f6ed15d49", "name": "network-vif-plugged", "status": "completed", "tag": "9a0b7777-bdfd-4168-abd4-ad7018402896"}, {"server_uuid": "1120efe8-bc65-4df7-88b6-91c5a05e0df6", "name": "network-vif-plugged", "status": "completed", "tag": "fb530b84-13d0-48d3-bd34-ebc3797cfd0b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:22.731044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d4f668a4-c804-4436-b293-e2370f82cf2d req-fdd86297-7238-426b-9e5d-36ec8ae156c8 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.731487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d4f668a4-c804-4436-b293-e2370f82cf2d req-fdd86297-7238-426b-9e5d-36ec8ae156c8 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.746870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-d4f668a4-c804-4436-b293-e2370f82cf2d req-fdd86297-7238-426b-9e5d-36ec8ae156c8 service nova] Creating event network-vif-plugged:9a0b7777-bdfd-4168-abd4-ad7018402896 for instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 on hv-cinder-76810 Jun 29 09:59:22.747373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-d4f668a4-c804-4436-b293-e2370f82cf2d req-fdd86297-7238-426b-9e5d-36ec8ae156c8 service nova] Creating event network-vif-plugged:fb530b84-13d0-48d3-bd34-ebc3797cfd0b for instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 on hv-cinder-76810 Jun 29 09:59:22.753943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-d4f668a4-c804-4436-b293-e2370f82cf2d req-fdd86297-7238-426b-9e5d-36ec8ae156c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039239 Jun 29 09:59:22.755312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 81/159] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:22.805441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:22.806372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:22.809292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=91 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:22.832618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.835285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.836223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.841369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.980228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8664d94a-1c9a-45ea-900b-98bb73f8ff91"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:22.981405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:22.988745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.991140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:22.992232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:22.992812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:23.280164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:23.289084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-812c6015-cf2b-4f03-955a-ea097dc9cb0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.493901 Jun 29 09:59:23.293940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:22 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:23.343497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:23.344764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:23.360702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:23.361554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:23.362354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:23.362826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:23.903837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:23.959483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6a030134-04cd-49c9-ac45-8f08a6747ef9 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "POST /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.984624 Jun 29 09:59:23.960988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 82/161] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 09:59:22 2022] POST /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:23.994031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:24.011726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f1c57a9-7186-4b7d-997f-ca2cb90e78e4 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1555 microversion: 2.1 time: 0.673420 Jun 29 09:59:24.012358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 80/162] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:23 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1555 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:24.035955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:24.037460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:24.066255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:24.066967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:24.069145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:24.070737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:24.218276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1980948-d8a7-4e8d-9864-585176120ff2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190175 Jun 29 09:59:24.219217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 83/163] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 09:59:24 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:24.312166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:24.313226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:24.321289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:24.321984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:24.322957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:24.323948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:24.763444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:24.776939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-142f8735-c602-4648-8f00-c34988e6ac0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1322 microversion: 2.1 time: 0.467321 Jun 29 09:59:24.790616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 81/164] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:24 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:24.988599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a01526d6-6033-48e5-b6e2-98d610684cb0 req-64df2551-079d-4ad6-9bf2-b1afb8893bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:25.008185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a01526d6-6033-48e5-b6e2-98d610684cb0 req-64df2551-079d-4ad6-9bf2-b1afb8893bb9 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:25.008632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a01526d6-6033-48e5-b6e2-98d610684cb0 req-64df2551-079d-4ad6-9bf2-b1afb8893bb9 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:25.031034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a01526d6-6033-48e5-b6e2-98d610684cb0 req-64df2551-079d-4ad6-9bf2-b1afb8893bb9 service nova] Creating event network-changed:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 09:59:25.044215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a01526d6-6033-48e5-b6e2-98d610684cb0 req-64df2551-079d-4ad6-9bf2-b1afb8893bb9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061397 Jun 29 09:59:25.045010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 84/165] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:25.797528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:25.798176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:25.813538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:25.816980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:25.819538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:25.821832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.395528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:26.411357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce0c2e33-d121-4ce9-92e3-5922584153ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1515 microversion: 2.1 time: 0.614033 Jun 29 09:59:26.413258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 82/166] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:25 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1515 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:26.432511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:26.433563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:26.449503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.450156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.451009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.451449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.504531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'flavor' on Instance uuid d3babafc-afb4-4eae-b574-eb9f6ed15d49 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 09:59:26.552270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-7d65d043-d5de-427d-be39-cbbd663558c1 req-74f7acf7-7e62-4cd2-bcb0-1d5cc0a8b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddf1295-57be-4e50-8403-e2ed8353c18c", "tag": "b0721056-6a1f-408b-a2d5-9b3182abad69"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:26.579165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7d65d043-d5de-427d-be39-cbbd663558c1 req-74f7acf7-7e62-4cd2-bcb0-1d5cc0a8b3c4 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.580174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7d65d043-d5de-427d-be39-cbbd663558c1 req-74f7acf7-7e62-4cd2-bcb0-1d5cc0a8b3c4 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.648535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-7d65d043-d5de-427d-be39-cbbd663558c1 req-74f7acf7-7e62-4cd2-bcb0-1d5cc0a8b3c4 service nova] Creating event network-changed:b0721056-6a1f-408b-a2d5-9b3182abad69 for instance 1ddf1295-57be-4e50-8403-e2ed8353c18c on hv-cinder-76810 Jun 29 09:59:26.651292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-7d65d043-d5de-427d-be39-cbbd663558c1 req-74f7acf7-7e62-4cd2-bcb0-1d5cc0a8b3c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 09:59:26.655417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.660380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.662491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.664165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.688123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.compute.rpcapi [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 09:59:26.690875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] Releasing lock "compute-rpcapi-router" {{(pid=117951) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 09:59:26.731821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97a49d8b-d2ca-4682-81c5-67cfa4bf4c5f None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185949 Jun 29 09:59:26.733821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 83/167] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:26.795593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a5eb06ad-ec3c-4c6d-b994-1294e315c7ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49/action" status: 200 len: 32 microversion: 2.1 time: 0.369541 Jun 29 09:59:26.805238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 85/168] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 09:59:26 2022] POST /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49/action => generated 32 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 09:59:26.814068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:26.815181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:26.834115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.836119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:26.840477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:26.842549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:27.725126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:27.735882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ffcfaf7-d4a7-4f3d-b07c-b99de977cace tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.924949 Jun 29 09:59:27.736779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:26 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:28.755793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:28.756653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:28.770635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:28.772501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:28.773757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:28.775977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:29.364252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:29.376844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a8ad2e5f-0c1d-4676-85e0-05d11504f4b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.626662 Jun 29 09:59:29.379562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 86/170] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:28 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:30.119565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1874987750", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "networks": [{"uuid": "ddeb4c2b-6c4e-411f-accf-f1a0a289fa65"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:30.174224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] validate_networks() for [('ddeb4c2b-6c4e-411f-accf-f1a0a289fa65', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:59:30.394929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:30.396331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:30.408284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:30.411484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:30.412395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:30.414796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:30.661348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:30.663640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:59:30.664124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:59:30.664611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:59:30.665185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:59:30.665606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:59:30.671221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7f5704a7-a7ac-408b-bc0e-b9d897fbaf6b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.281219 Jun 29 09:59:30.671991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 87/171] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:30 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:30.675994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:30.676675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:30.677713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:30.678154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:30.697601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Getting quotas for project 5c61e1258f5d44ba903a0132415437c6. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:59:30.702161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Getting quotas for user 1694bd50d03f4d0f9c2ccee1b0775e12 and project 5c61e1258f5d44ba903a0132415437c6. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:59:30.715345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:59:30.717962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:59:30.773394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c07650b6-05b8-4840-9e4f-54dac2417753 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657113 Jun 29 09:59:30.778812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 85/172] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 09:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 09:59:30.785488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b550fb45-1ffa-431c-a759-f543f501eb90 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:30.786303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b550fb45-1ffa-431c-a759-f543f501eb90 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:30.861453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b550fb45-1ffa-431c-a759-f543f501eb90 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:30.869667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b550fb45-1ffa-431c-a759-f543f501eb90 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1214 microversion: 2.1 time: 0.089344 Jun 29 09:59:30.871846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 88/173] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:30 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:31.695106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:31.695106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:31.695636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:31.695850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:31.697106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:31.697715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:31.874408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:31.886828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:31.887453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:31.895767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae9bee8f-178d-41b1-a0d8-e5b2ae9944ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.210963 Jun 29 09:59:31.896292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 86/174] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:31 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:31.911019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:31.911580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:31.912676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:31.913561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:32.022228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:32.031185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7152ac82-e8ff-4b35-932a-1ca960129452 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1266 microversion: 2.1 time: 0.148210 Jun 29 09:59:32.034044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 89/175] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:31 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:32.915852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:32.916475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:32.922678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:32.923131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:32.923949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:32.924388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:33.053934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:33.055392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:33.078212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:33.082937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:33.088165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:33.090344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:33.136228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:33.150808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc081677-fefb-4ce4-be67-74ecff56f3d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.238971 Jun 29 09:59:33.163899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 87/176] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:32 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:33.298637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:33.307206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-042a4b1c-bc87-49cb-a563-7d9bac56412d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.259466 Jun 29 09:59:33.307797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 90/177] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:33 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:34.168296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:34.169327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:34.177486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:34.178079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:34.179352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:34.180028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:34.324618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:34.325852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:34.334723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:34.335508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:34.336528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:34.337511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:34.389645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:34.404358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7333c8e5-4faf-4bfd-a04f-9e8d7d53decd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.240252 Jun 29 09:59:34.405443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 88/178] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:34 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:34.617727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:34.631220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ea01e269-9838-4565-beba-7f73dafccedf tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.309334 Jun 29 09:59:34.642638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 91/179] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:34 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:34.852270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-41c1e8f1-725b-4c0c-85d5-cf305240b2f7 req-ee0619e2-281d-4452-b824-d2d09ede4762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac58a37-61bd-4e5c-81fe-ae25fdebde9c", "tag": "ca2b7528-d8e0-4875-8bad-6a8ab16fa2a3"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:34.864878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-41c1e8f1-725b-4c0c-85d5-cf305240b2f7 req-ee0619e2-281d-4452-b824-d2d09ede4762 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:34.865975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-41c1e8f1-725b-4c0c-85d5-cf305240b2f7 req-ee0619e2-281d-4452-b824-d2d09ede4762 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:34.874138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:34.902325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-41c1e8f1-725b-4c0c-85d5-cf305240b2f7 req-ee0619e2-281d-4452-b824-d2d09ede4762 service nova] Creating event network-changed:ca2b7528-d8e0-4875-8bad-6a8ab16fa2a3 for instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c on hv-cinder-76810 Jun 29 09:59:34.908012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-41c1e8f1-725b-4c0c-85d5-cf305240b2f7 req-ee0619e2-281d-4452-b824-d2d09ede4762 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059564 Jun 29 09:59:34.909060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 89/180] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:35.425433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:35.429140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:35.438431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.439556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.440456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.441111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.504424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:35.505895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:35.516938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.518110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.520299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.520974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.554949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 09:59:35.605663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:35.614518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6441f328-8064-4d6e-bfcb-a46ddeffc8c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.194260 Jun 29 09:59:35.615492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 92/181] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:35 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:35.647793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:35.648413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:35.656855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.660339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.661309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.661777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.778330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a21a2de9-d531-4c8c-87c7-3cc523ce385c tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 204 len: 0 microversion: 2.1 time: 0.278852 Jun 29 09:59:35.779163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 90/182] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 09:59:35 2022] DELETE /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 09:59:35.790073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:35.791050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:35.798554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.799248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.800194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:35.800628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:35.929147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:35.947292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-57124a49-ea1c-44b1-9b2c-003153a3cd29 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.303186 Jun 29 09:59:35.947892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 93/183] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:35 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:36.006227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:36.015068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f7a68447-f74e-4a93-9aed-62f5f0579cad tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1552 microversion: 2.1 time: 0.230712 Jun 29 09:59:36.015964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 91/184] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:35 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:36.631407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:36.632021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:36.645725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:36.648161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:36.648986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:36.649431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:36.806805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:36.816011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b98591e9-d856-41b2-8d18-5720934a60da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.188201 Jun 29 09:59:36.817413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 94/185] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:36 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:36.966341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:36.967633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:36.974474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:36.975592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:36.976524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:36.977094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:37.033781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:37.034606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:37.048913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:37.055503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:37.055503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:37.055503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:37.192311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:37.204933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4c4a2f9-8b28-4823-9b6b-cb05092a8436 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.242636 Jun 29 09:59:37.208204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 92/186] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:36 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:37.261012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:37.273852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1fd41179-5fd4-40c5-9ba9-1d33e396965f tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1552 microversion: 2.1 time: 0.240216 Jun 29 09:59:37.273852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 95/187] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:37 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1552 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:37.834971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:37.835672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:37.842958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:37.843928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:37.844931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:37.845643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:38.004008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:38.011938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-994c412c-daff-4b24-a4ae-4154cd4a3eb9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.182305 Jun 29 09:59:38.012542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 93/188] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:37 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:38.226943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:38.228365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:38.235228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:38.235679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:38.236549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:38.237091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:38.287352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:38.287862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:38.294159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:38.294846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:38.295785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:38.296206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:38.442133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:38.449689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:38.451592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60bb3280-18d8-42df-8cfd-2ddd3c72c954 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1552 microversion: 2.1 time: 0.167949 Jun 29 09:59:38.457109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 94/189] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:38 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:38.468439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1d245983-368f-4154-b669-cff1831f50a3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.246987 Jun 29 09:59:38.469268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 96/190] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:38 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:39.029470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:39.029949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:39.036372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.036816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.037575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.037998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.215986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:39.228608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5eb84e3-cc0b-4ede-b241-5ab3d487ebf4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.202864 Jun 29 09:59:39.231472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 95/191] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:39 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:39.474336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:39.475003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:39.481971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.482788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.483841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.484608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.485299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:39.486036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:39.494539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.495081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.495859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.496288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.665678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:39.675000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ebdfdd2d-aced-433a-9280-789ace73f3f3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.193311 Jun 29 09:59:39.675818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 96/192] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:39 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:39.735961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0db12362-c5cf-41f8-8224-4c63f5ce1102 req-b5016608-37b8-4ffd-959d-cf4a7622027a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda5f73a-de16-48fa-b51d-1ad23f583de6", "name": "network-vif-deleted", "tag": "063aad5d-365b-4b91-85a8-eb1ef8386318"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:39.744841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0db12362-c5cf-41f8-8224-4c63f5ce1102 req-b5016608-37b8-4ffd-959d-cf4a7622027a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:39.745627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0db12362-c5cf-41f8-8224-4c63f5ce1102 req-b5016608-37b8-4ffd-959d-cf4a7622027a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:39.754912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:39.763592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c6361a9f-7d6c-4e3c-8c65-0e4f3d093894 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1552 microversion: 2.1 time: 0.293467 Jun 29 09:59:39.764774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0db12362-c5cf-41f8-8224-4c63f5ce1102 req-b5016608-37b8-4ffd-959d-cf4a7622027a service nova] Creating event network-vif-deleted:063aad5d-365b-4b91-85a8-eb1ef8386318 for instance bda5f73a-de16-48fa-b51d-1ad23f583de6 on hv-cinder-76810 Jun 29 09:59:39.764902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 97/193] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:39 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1552 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:39.771462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0db12362-c5cf-41f8-8224-4c63f5ce1102 req-b5016608-37b8-4ffd-959d-cf4a7622027a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038968 Jun 29 09:59:39.772203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 97/194] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:40.252823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:40.253588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:40.260736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:40.261201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:40.261987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:40.262426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:40.506119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:40.509696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:40.515435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6b61d6eb-fb65-4f6a-a867-f9579f0912da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.267074 Jun 29 09:59:40.516449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 98/195] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:40 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:40.690815 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:40.696284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:40.697957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:40.708814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:40.709518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:40.710826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:40.711354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:40.712193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:40.786013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:40.786837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:40.794061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:40.795142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:40.796202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:40.796948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:40.871694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:40.873514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:40.882705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-460b867b-37e8-4470-a315-923c85448f73 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.192844 Jun 29 09:59:40.883419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 98/196] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:40 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:41.113480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:41.123783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-39b3657d-3a6f-4a21-875e-6d2074dc5543 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1510 microversion: 2.1 time: 0.344026 Jun 29 09:59:41.124724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 99/197] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:40 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:41.532987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:41.533468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:41.541386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:41.542240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:41.543038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:41.543467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:41.699393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:41.707362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-606a1b11-ea97-41cf-b788-0a94af67abf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.178758 Jun 29 09:59:41.707959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 99/198] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:41 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:41.906269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:41.906975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:41.913971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:41.914526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:41.915404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:41.915839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:42.152993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:42.162910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:42.178127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:42.188086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:42.192931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:42.193855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:42.252593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:42.270362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c4cb5772-6a74-4a1d-ae2f-b6c72a982bc7 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.368190 Jun 29 09:59:42.271397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 100/199] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:41 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:42.300923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:42.310530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a3642f4b-4315-409e-8aea-8705e58bb589 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1344 microversion: 2.1 time: 0.161431 Jun 29 09:59:42.311328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 100/200] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:42 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:42.447878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-c3468c7c-32bd-489b-8570-73ed0280e5f1 req-169fcbfd-9281-4018-bfba-ac7c380ea3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac58a37-61bd-4e5c-81fe-ae25fdebde9c", "name": "network-vif-plugged", "status": "completed", "tag": "ca2b7528-d8e0-4875-8bad-6a8ab16fa2a3"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:42.466833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c3468c7c-32bd-489b-8570-73ed0280e5f1 req-169fcbfd-9281-4018-bfba-ac7c380ea3f7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:42.468031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c3468c7c-32bd-489b-8570-73ed0280e5f1 req-169fcbfd-9281-4018-bfba-ac7c380ea3f7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:42.488104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-c3468c7c-32bd-489b-8570-73ed0280e5f1 req-169fcbfd-9281-4018-bfba-ac7c380ea3f7 service nova] Creating event network-vif-plugged:ca2b7528-d8e0-4875-8bad-6a8ab16fa2a3 for instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c on hv-cinder-76810 Jun 29 09:59:42.496021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-c3468c7c-32bd-489b-8570-73ed0280e5f1 req-169fcbfd-9281-4018-bfba-ac7c380ea3f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055958 Jun 29 09:59:42.497064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 101/201] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:42.726349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:42.727257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:42.739482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:42.739931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:42.740710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:42.741139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:43.219671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:43.231485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-38d34e55-f0d4-4f62-a29b-5b7d86b1d99b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.510533 Jun 29 09:59:43.237390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 101/202] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:42 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:43.288443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:43.290611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:43.304605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:43.305062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:43.305859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:43.308106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:43.327843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:43.328807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:43.344753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:43.347905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:43.349014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:43.350959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:43.433741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:43.435290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:43.437521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lazy-loading 'fault' on Instance uuid bda5f73a-de16-48fa-b51d-1ad23f583de6 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 09:59:43.516800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57605be4d856407f9ac4828ee1fef041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f49f1727f4327be986e4f7e131200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:43.526212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10eab393-6373-41d6-805d-2b0bd5aceac5 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 200 len: 1303 microversion: 2.1 time: 0.201833 Jun 29 09:59:43.527678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 102/203] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:43 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:43.557778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:43.569840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dc008073-1eb4-4ea9-8355-8213fafa2aae tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.286189 Jun 29 09:59:43.570442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 102/204] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:43 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:44.254484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:44.255289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:44.264584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.266016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.267471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.268067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.544871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:44.545431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:44.554187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.554880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.555825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.556249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.592196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] HTTP exception thrown: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Request method failure captured: Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 HTTP/1.1 Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJKmwuPUK6nvPDJpPJpKerr2_EWx2hrGPImBgKjHU9wiRPuFkz1tihHw5YynaBLJ2CfKQ8JMXo10r1KpUeLbpLTVdAC4piM6_c5u_ZJgXsH24GCVF7rkjuEzI9wnkVI3BKMGfwhiIOBk_y9RAwN7c7wMDdP6cWytz3darF0uOqfcdI Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 09:59:44.597409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e10f49f1727f4327be986e4f7e131200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 57605be4d856407f9ac4828ee1fef041 Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.598977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': 'bda5f73a-de16-48fa-b51d-1ad23f583de6'} Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:59:44.599789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.601065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.603986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Returning 404 to user: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:59:44.605176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b0988c08-9dcb-460e-b161-53afcf7a35fc tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 404 len: 111 microversion: 2.1 time: 0.064180 Jun 29 09:59:44.606017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 103/205] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:44 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 09:59:44.615209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:44.616024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:44.624170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.624622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.625396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.625867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.680900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:44.692222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cca70d0c-91d4-4e56-880b-6755fd91e56a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.442571 Jun 29 09:59:44.694118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 103/206] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:44 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:44.837759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:44.838897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:44.846885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.847327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.848485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:44.849802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:44.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:44.876451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9139bdd3-f901-42a4-87d6-6beb5c6b23b5 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1314 microversion: 2.1 time: 0.265774 Jun 29 09:59:44.877135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 104/207] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:44 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:44.879347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] HTTP exception thrown: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Request method failure captured: Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6/os-volume_attachments HTTP/1.1 Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJKmwuPUK6nvPDJpPJpKerr2_EWx2hrGPImBgKjHU9wiRPuFkz1tihHw5YynaBLJ2CfKQ8JMXo10r1KpUeLbpLTVdAC4piM6_c5u_ZJgXsH24GCVF7rkjuEzI9wnkVI3BKMGfwhiIOBk_y9RAwN7c7wMDdP6cWytz3darF0uOqfcdI Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:59:44.884434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e10f49f1727f4327be986e4f7e131200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 57605be4d856407f9ac4828ee1fef041 Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.885662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'bda5f73a-de16-48fa-b51d-1ad23f583de6'} Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:59:44.886300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:44.887412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:44.889920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Returning 404 to user: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:59:44.889920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b1399dc-078e-42db-ba8f-a9298f4e6af0 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053256 Jun 29 09:59:44.889920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 104/208] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 09:59:44 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 09:59:45.714322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:45.714968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:45.723718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:45.724626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:45.725580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:45.726036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:45.885176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:45.895557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:45.897072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:45.905446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1ade12e4-9af8-4abc-ba3d-541389a36217 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.199231 Jun 29 09:59:45.908742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 105/209] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:45 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:45.910682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:45.911400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:45.912421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:45.913061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.073424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:46.077190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:46.081989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-28d572b4-2029-4357-ae26-91ff858a2d00 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1499 microversion: 2.1 time: 0.192553 Jun 29 09:59:46.083036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 105/210] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:45 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1499 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:46.149819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:46.153203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:46.166225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.174658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.175512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.175964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.205001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] HTTP exception thrown: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Request method failure captured: Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 HTTP/1.1 Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJKmwuPUK6nvPDJpPJpKerr2_EWx2hrGPImBgKjHU9wiRPuFkz1tihHw5YynaBLJ2CfKQ8JMXo10r1KpUeLbpLTVdAC4piM6_c5u_ZJgXsH24GCVF7rkjuEzI9wnkVI3BKMGfwhiIOBk_y9RAwN7c7wMDdP6cWytz3darF0uOqfcdI Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 09:59:46.206787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e10f49f1727f4327be986e4f7e131200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 57605be4d856407f9ac4828ee1fef041 Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.208018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': 'bda5f73a-de16-48fa-b51d-1ad23f583de6'} Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:59:46.208667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.209715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.213739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Returning 404 to user: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:59:46.215351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d9d730e4-2829-4add-b29e-06ef14aeb291 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 404 len: 111 microversion: 2.1 time: 0.074194 Jun 29 09:59:46.219559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 106/211] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 09:59:46 2022] DELETE /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 09:59:46.227716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:46.228593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] [instance: bda5f73a-de16-48fa-b51d-1ad23f583de6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:46.242807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.243305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.244146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.246004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.270814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] HTTP exception thrown: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Request method failure captured: Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 HTTP/1.1 Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJKmwuPUK6nvPDJpPJpKerr2_EWx2hrGPImBgKjHU9wiRPuFkz1tihHw5YynaBLJ2CfKQ8JMXo10r1KpUeLbpLTVdAC4piM6_c5u_ZJgXsH24GCVF7rkjuEzI9wnkVI3BKMGfwhiIOBk_y9RAwN7c7wMDdP6cWytz3darF0uOqfcdI Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 09:59:46.273584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e10f49f1727f4327be986e4f7e131200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e10f49f1727f4327be986e4f7e131200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: e10f49f1727f4327be986e4f7e131200 Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-DeleteServersTestJSON-1479179498 Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 57605be4d856407f9ac4828ee1fef041 Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-DeleteServersTestJSON-1479179498-project Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.275014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': 'bda5f73a-de16-48fa-b51d-1ad23f583de6'} Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:59:46.275823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. Jun 29 09:59:46.277113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 09:59:46.279193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] Returning 404 to user: Instance bda5f73a-de16-48fa-b51d-1ad23f583de6 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:59:46.280033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8311ac00-469d-4c7e-a658-cd6a2f656d03 tempest-DeleteServersTestJSON-1479179498 tempest-DeleteServersTestJSON-1479179498-project] 10.222.0.52 "GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6" status: 404 len: 111 microversion: 2.1 time: 0.059836 Jun 29 09:59:46.280892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 106/212] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:46 2022] GET /compute/v2.1/servers/bda5f73a-de16-48fa-b51d-1ad23f583de6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 09:59:46.698016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:46.698522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:46.707087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.707538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.710544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.710986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.746832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 09:59:46.909523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b46362fc-1e05-4d74-8355-86e5a7eafef2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 204 len: 0 microversion: 2.1 time: 0.215061 Jun 29 09:59:46.910937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 107/213] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 09:59:46 2022] DELETE /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 09:59:46.925722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:46.927165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:46.944753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.945835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.948780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.949375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.949853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:46.951357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:46.984704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.985181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:46.991220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:46.991930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:47.243575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:47.258933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e39d65bc-550a-4414-892f-f06a58a029a4 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1505 microversion: 2.1 time: 0.342014 Jun 29 09:59:47.262691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 107/214] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:46 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:47.462275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:47.473582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b5548bd5-cd57-4218-94d2-74e73e823aaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.537716 Jun 29 09:59:47.478809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 108/215] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:46 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:48.280057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:48.280828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:48.305978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:48.306749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:48.308306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:48.308810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:48.496206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:48.496985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:48.511701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:48.512254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:48.515961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:48.519355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:48.775696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:48.795527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1916ca73-1ede-43b1-9c1d-194d09c2b0c6 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1505 microversion: 2.1 time: 0.521772 Jun 29 09:59:48.806429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 108/216] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:48 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:49.130139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:49.144498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-db884aa2-88f8-476c-8521-b0954e73960e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.652419 Jun 29 09:59:49.146983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 109/217] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:48 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:49.813041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:49.814111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:49.826695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:49.829288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:49.831486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:49.832535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:49.950936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:49.969022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb97cd56-97f5-4acb-a405-dbb051277e2d tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 200 len: 1463 microversion: 2.1 time: 0.158229 Jun 29 09:59:49.972315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 109/218] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:49 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:49.974189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-6f7189f7-446f-4a1d-881d-a739e2ae5c66 req-2623d0ca-a7b2-4862-8681-fd439f6608fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac58a37-61bd-4e5c-81fe-ae25fdebde9c", "name": "network-vif-deleted", "tag": "ca2b7528-d8e0-4875-8bad-6a8ab16fa2a3"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:50.005245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6f7189f7-446f-4a1d-881d-a739e2ae5c66 req-2623d0ca-a7b2-4862-8681-fd439f6608fd service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:50.005991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-6f7189f7-446f-4a1d-881d-a739e2ae5c66 req-2623d0ca-a7b2-4862-8681-fd439f6608fd service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:50.036102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-6f7189f7-446f-4a1d-881d-a739e2ae5c66 req-2623d0ca-a7b2-4862-8681-fd439f6608fd service nova] Creating event network-vif-deleted:ca2b7528-d8e0-4875-8bad-6a8ab16fa2a3 for instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c on hv-cinder-76810 Jun 29 09:59:50.055075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-6f7189f7-446f-4a1d-881d-a739e2ae5c66 req-2623d0ca-a7b2-4862-8681-fd439f6608fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084591 Jun 29 09:59:50.056668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 110/219] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:50.169643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:50.171447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:50.184461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:50.185026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:50.186938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:50.188584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:50.991168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:50.992438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:51.007744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:51.019536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:51.021810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:51.023020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:51.023641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:51.049704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] HTTP exception thrown: Instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c could not be found. Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Request method failure captured: Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c HTTP/1.1 Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJ_nerEpZBxePxzAsbLuHIxTcj5RXhKZtizRWKU_XWrYzpoclZeU9SyyaJjAMF08OCXSlexYbGWSw3yG5bfoer8DCufgiqK96uAs7vSJfN7jXIuWF0Z-m30Q_TleAmoYZu89VIpU8DJnHtGqsqHtTudW4vf3pUpsYX7xarwHl7U-Lk Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 5c61e1258f5d44ba903a0132415437c6 Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesActionsTest-1165164319 Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 09:59:51.051830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesActionsTest-1165164319 Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 5c61e1258f5d44ba903a0132415437c6 Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesActionsTest-1165164319 Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesActionsTest-1165164319-project Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 1694bd50d03f4d0f9c2ccee1b0775e12 Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesActionsTest-1165164319-project Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c could not be found. Jun 29 09:59:51.053131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '8ac58a37-61bd-4e5c-81fe-ae25fdebde9c'} Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c could not be found. Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 09:59:51.053868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c could not be found. Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c could not be found. Jun 29 09:59:51.055015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 09:59:51.058684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Returning 404 to user: Instance 8ac58a37-61bd-4e5c-81fe-ae25fdebde9c could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 09:59:51.059808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9e35f50b-09f7-4541-a99f-7130b54df372 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c" status: 404 len: 111 microversion: 2.1 time: 0.074795 Jun 29 09:59:51.060649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 111/220] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:50 2022] GET /compute/v2.1/servers/8ac58a37-61bd-4e5c-81fe-ae25fdebde9c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 09:59:51.247542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1630937161", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "networks": [{"uuid": "ddeb4c2b-6c4e-411f-accf-f1a0a289fa65"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:51.347126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] validate_networks() for [('ddeb4c2b-6c4e-411f-accf-f1a0a289fa65', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 09:59:51.567789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:51.577436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-462067db-9072-42bb-ba2c-52ffbd0c64d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 1.416652 Jun 29 09:59:51.583993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 110/221] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:50 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:52.597468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:52.598832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:52.605607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:52.606280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:52.607263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:52.607837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:53.014253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:53.024580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d2df733-eccb-493f-ac43-58dd0b5b11b5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.431004 Jun 29 09:59:53.028239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 111/222] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:52 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:53.308294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 09:59:53.308752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 09:59:53.309226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 09:59:53.312438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 09:59:53.312438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 09:59:53.335202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:53.335580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:53.339729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:53.340260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:53.380498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Getting quotas for project 5c61e1258f5d44ba903a0132415437c6. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:59:53.385412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Getting quotas for user 1694bd50d03f4d0f9c2ccee1b0775e12 and project 5c61e1258f5d44ba903a0132415437c6. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:59:53.400068 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 09:59:53.403187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 09:59:53.469487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1ce1687c-7b7f-4f40-bc80-02c163d2deed tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.226153 Jun 29 09:59:53.476214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 112/223] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 09:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 09:59:53.481576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c95e8384-936c-4c25-8950-ad1600bbac86 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:53.482186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c95e8384-936c-4c25-8950-ad1600bbac86 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:53.492206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 09:59:53.647384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c95e8384-936c-4c25-8950-ad1600bbac86 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:53.658219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c95e8384-936c-4c25-8950-ad1600bbac86 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1214 microversion: 2.1 time: 0.180791 Jun 29 09:59:53.661813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 112/224] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:53 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:54.042037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:54.043798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:54.074944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:54.076410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:54.081264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:54.082002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:54.683949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:54.688320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:54.699970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:54.715622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:54.720940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:54.722657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:54.857242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:54.891542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7b1ad58-f505-42ac-8d4e-dc440a85c112 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1210 microversion: 2.1 time: 0.216307 Jun 29 09:59:54.905370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 113/225] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:54 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1210 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:55.074873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:55.089621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9b758a95-fee6-4a60-ac1b-7e9931099eb0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 1.051617 Jun 29 09:59:55.091051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 113/226] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:54 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:55.910961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:55.912006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:55.924957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:55.928035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:55.929287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:55.932026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:56.108205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-32a84c9e-9132-4502-984b-78e781d68dec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Action: 'create', calling method: .version_select at 0x7f38706ca160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-698110575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsllT63QP5xG9lY1B0vrJtOXAY2VCDnLOjeo74QdZqPW1o5iAvENGYPkfka9JGFUheC1bNPOF7MW8SS4TojEVqUtDJZrJs7XEXvUjm7x1y7ZRoe06NX0HZFgb+6mvKMXQ=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:56.145702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-32a84c9e-9132-4502-984b-78e781d68dec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Getting quotas for project 0192e4102b644993a9482674674b1ad7. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 09:59:56.157282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-32a84c9e-9132-4502-984b-78e781d68dec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Getting quotas for user 48ff681e601f4892abffe5862def0547 and project 0192e4102b644993a9482674674b1ad7. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 09:59:56.205605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:56.224096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-502dbc3d-ecd4-48b1-abf6-572ced3a7766 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1272 microversion: 2.1 time: 0.311630 Jun 29 09:59:56.224752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 114/227] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:55 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:56.254408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:56.257384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:56.260683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-32a84c9e-9132-4502-984b-78e781d68dec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.662162 Jun 29 09:59:56.261290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 114/228] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 09:59:55 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:56.269800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:56.270269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:56.271153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:56.271681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:57.129622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:57.141370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7c43a8f3-aa8d-47eb-8c98-8592f7394b64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.902004 Jun 29 09:59:57.144224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 115/229] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:56 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:57.247053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:57.247900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:57.258523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:57.260524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:57.261606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:57.263118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:57.715235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:57.726424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-29dd27c9-5b6c-4f87-b225-cefeb47d2e4c tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.488502 Jun 29 09:59:57.727097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 115/230] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:57 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:58.160756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:58.161711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:58.169446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:58.169901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:58.170711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:58.171142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:58.287668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a1c9577-e451-4639-a08f-917314ba6756 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Action: 'create', calling method: .version_select at 0x7f3870487dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-835651195"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:58.472569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:58.483459 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f66753df-bbf3-4694-9634-ad62cb30e080 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.326636 Jun 29 09:59:58.484080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 116/231] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:58 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 09:59:58.489032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ae0251d9-3bdb-48c7-9f5c-3b1a152e1bf0 req-dc341ffb-c6e8-47b0-b0b5-7a04f97b7200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47807f8-7fbd-4c57-a732-7652921aae81", "tag": "6fc71e28-031a-4091-ac84-2da3085eb61c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 09:59:58.497657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ae0251d9-3bdb-48c7-9f5c-3b1a152e1bf0 req-dc341ffb-c6e8-47b0-b0b5-7a04f97b7200 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:58.498168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ae0251d9-3bdb-48c7-9f5c-3b1a152e1bf0 req-dc341ffb-c6e8-47b0-b0b5-7a04f97b7200 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:58.517845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ae0251d9-3bdb-48c7-9f5c-3b1a152e1bf0 req-dc341ffb-c6e8-47b0-b0b5-7a04f97b7200 service nova] Creating event network-changed:6fc71e28-031a-4091-ac84-2da3085eb61c for instance f47807f8-7fbd-4c57-a732-7652921aae81 on hv-cinder-76810 Jun 29 09:59:58.532285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ae0251d9-3bdb-48c7-9f5c-3b1a152e1bf0 req-dc341ffb-c6e8-47b0-b0b5-7a04f97b7200 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046597 Jun 29 09:59:58.533177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 117/232] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 09:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 09:59:58.745767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:58.746464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:58.763744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:58.770357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:58.771628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:58.775124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:58.820987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a1c9577-e451-4639-a08f-917314ba6756 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.793054 Jun 29 09:59:58.821602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 116/233] 10.222.0.52 () {60 vars in 1154 bytes} [Wed Jun 29 09:59:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 795 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 09:59:58.835738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4bb160c1-3738-4142-9c30-34e82b62acc4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f387042e3a0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:59.038830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4bb160c1-3738-4142-9c30-34e82b62acc4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 200 len: 344 microversion: 2.1 time: 0.208145 Jun 29 09:59:59.044766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 117/234] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 09:59:58 2022] GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 344 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 09:59:59.051294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:59.070377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd42ce44-de02-4a26-b04a-3796c2038eb2 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.330179 Jun 29 09:59:59.071131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 118/235] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:58 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 09:59:59.504281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 09:59:59.505067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 09:59:59.518305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:59.522148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:59.523499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 09:59:59.525060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 09:59:59.712865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 09:59:59.723966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1dc8c690-a09c-4646-bd75-903d2d976f1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.227024 Jun 29 09:59:59.724784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 118/236] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 09:59:59 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:00.061002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b5309ed-b68b-456b-8d5d-518ef9bbe8ca tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3870493550>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:00.088761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:00.089373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:00.105009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:00.105895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:00.106961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:00.108410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:00.139550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b5309ed-b68b-456b-8d5d-518ef9bbe8ca tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 200 len: 345 microversion: 2.1 time: 0.086244 Jun 29 10:00:00.140546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 119/237] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:00:00 2022] GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:00.152909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64e54e29-1f7c-499e-a86e-d8b50d474cf5 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Action: 'create', calling method: .version_select at 0x7f387046fc10>, body: {"snapshot": {"volume_id": "71da76bb-10d2-4c5d-b516-aa17ae2cf0cc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-807282480"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:00.370959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64e54e29-1f7c-499e-a86e-d8b50d474cf5 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.222292 Jun 29 10:00:00.371631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 120/238] 10.222.0.52 () {60 vars in 1161 bytes} [Wed Jun 29 10:00:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:00:00.389341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13467189-4f09-4504-a5b5-94f1df9f5aec tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3871be3e50>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:00.440585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13467189-4f09-4504-a5b5-94f1df9f5aec tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 200 len: 286 microversion: 2.1 time: 0.061969 Jun 29 10:00:00.442863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 121/239] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:00 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:00.457879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4e67d8b-3a7e-4351-8e6b-9b3de3f1ba92 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3871b6ed30>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:00.505560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4e67d8b-3a7e-4351-8e6b-9b3de3f1ba92 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.054764 Jun 29 10:00:00.514590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 122/240] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Jun 29 10:00:00 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:00.521935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b6a873b-6189-4024-a729-2f7612ce3f91 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3870493a60>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:00.526271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:00.530801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:00.538417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7a0c1406-5df2-401d-bb25-f538037793b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.454069 Jun 29 10:00:00.539100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 119/241] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:00 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:00.565720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b6a873b-6189-4024-a729-2f7612ce3f91 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 200 len: 286 microversion: 2.1 time: 0.048746 Jun 29 10:00:00.567487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 123/242] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:00 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:00.741932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:00.742896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:00.772238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:00.772588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:00.773384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:00.773817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:01.297951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:01.306887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4c0392f8-e496-49b9-9791-324db58b6a59 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.569710 Jun 29 10:00:01.307469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 120/243] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:00 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:01.556196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:01.557442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:01.564287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:01.564630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:01.565573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:01.566007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:01.579369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80ced94d-cc5e-42fa-a8ae-89212271cc7f tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f387042e4c0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:01.624018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80ced94d-cc5e-42fa-a8ae-89212271cc7f tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 200 len: 286 microversion: 2.1 time: 0.049501 Jun 29 10:00:01.624596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 121/244] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:01 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:01.706221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:01.714820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e60e096d-14fe-4391-9286-27afe51e8033 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.162401 Jun 29 10:00:01.715416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 124/245] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:01 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:02.324347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:02.325680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:02.332672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:02.333001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:02.333786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:02.334215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:02.478737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:02.487434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2cd93f84-2a73-4e7b-946f-be8f6183cc80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.166857 Jun 29 10:00:02.488017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 122/246] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:02 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:02.635821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7fa0345-d5d8-42da-b7cd-e8d269da7914 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3870493430>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:02.678144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7fa0345-d5d8-42da-b7cd-e8d269da7914 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 200 len: 286 microversion: 2.1 time: 0.045799 Jun 29 10:00:02.678881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 125/247] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:02 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:02.732989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:02.733608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:02.741176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:02.741633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:02.742389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:02.742869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:02.882049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:02.890235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a13770e-9dc4-4123-82e5-ff5e29be1df3 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.161249 Jun 29 10:00:02.890853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 123/248] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:02 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:03.506373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:03.507077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:03.516589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:03.517387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:03.517941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:03.518616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:03.670920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:03.682174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c6374cc2-831c-48c4-b270-41d611bb6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.179439 Jun 29 10:00:03.682965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 126/249] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:03 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:03.692202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f02023c9-6043-4807-a40c-4164fc5eadc8 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f38707260d0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:03.699192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:03.700634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:03.731654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f02023c9-6043-4807-a40c-4164fc5eadc8 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 200 len: 287 microversion: 2.1 time: 0.043220 Jun 29 10:00:03.732443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 124/250] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:03 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:03.743765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03094c09-549d-470e-a8d7-a366c2e443d3 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f38704be700>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:03.804994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03094c09-549d-470e-a8d7-a366c2e443d3 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 202 len: 0 microversion: 2.1 time: 0.065193 Jun 29 10:00:03.805611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 127/251] 10.222.0.52 () {58 vars in 1253 bytes} [Wed Jun 29 10:00:03 2022] DELETE /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:00:03.814813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9254886-f918-45d3-a068-382d549e51e2 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f38705f5b80>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:03.849686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9254886-f918-45d3-a068-382d549e51e2 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 200 len: 286 microversion: 2.1 time: 0.039576 Jun 29 10:00:03.850279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 125/252] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:03 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:03.909272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:03.909786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:03.916280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:03.916728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:03.917496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:03.917932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:04.075417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:04.083617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e18447af-44d5-440b-a624-7a5a83ca8a26 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.179682 Jun 29 10:00:04.084191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 128/253] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:03 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:04.677792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a0996c86-ac73-49a8-b693-18b76935b62f req-81a05d24-f6f0-4359-8eef-92b219c58220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47807f8-7fbd-4c57-a732-7652921aae81", "name": "network-vif-plugged", "status": "completed", "tag": "6fc71e28-031a-4091-ac84-2da3085eb61c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:04.688282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a0996c86-ac73-49a8-b693-18b76935b62f req-81a05d24-f6f0-4359-8eef-92b219c58220 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:04.688723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a0996c86-ac73-49a8-b693-18b76935b62f req-81a05d24-f6f0-4359-8eef-92b219c58220 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:04.702721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:04.703178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a0996c86-ac73-49a8-b693-18b76935b62f req-81a05d24-f6f0-4359-8eef-92b219c58220 service nova] Creating event network-vif-plugged:6fc71e28-031a-4091-ac84-2da3085eb61c for instance f47807f8-7fbd-4c57-a732-7652921aae81 on hv-cinder-76810 Jun 29 10:00:04.703299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:04.710666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a0996c86-ac73-49a8-b693-18b76935b62f req-81a05d24-f6f0-4359-8eef-92b219c58220 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Jun 29 10:00:04.711614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 126/254] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:04.715910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:04.716575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:04.717794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:04.718875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:04.863281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6629a8c5-5f55-4595-8211-37e9039edddc tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f38705f5670>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:04.892694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-6629a8c5-5f55-4595-8211-37e9039edddc tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] HTTP exception thrown: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6629a8c5-5f55-4595-8211-37e9039edddc tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Request method failure captured: Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 HTTP/1.1 Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCKdHNfTAmQkjOwbCbEcwHiA5W3KiLoBN6Hp_vaBTG0KFPTXrtSEyqvi3SkR5ch3uzJ8bn3vAY27WJfQ9FZrlK0f-Xl4FINSpOoBg1M_J6ZSgSL6m6_KEJWD-ZFfidBqqDXzkAPZPydt8LL40pP7LDFZOGvi8KwYnt9BXZREU209yZs Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:00:04.896531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08d103b7e2db492691cda72117de6142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08d103b7e2db492691cda72117de6142"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 587c22b1c33649119b6c9bfa5f77121a Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '1af89bab-13c8-467f-bf18-530824749694'} Jun 29 10:00:04.897852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. (HTTP 404) (Request-ID: req-8eeae8b2-775c-469c-9693-5e4350d74449) Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.898964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:00:04.900242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 29 10:00:04.901386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6629a8c5-5f55-4595-8211-37e9039edddc tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Returning 404 to user: Snapshot 1af89bab-13c8-467f-bf18-530824749694 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:00:04.903282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6629a8c5-5f55-4595-8211-37e9039edddc tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694" status: 404 len: 111 microversion: 2.1 time: 0.039775 Jun 29 10:00:04.904153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 127/255] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:00:04 2022] GET /compute/v2.1/os-snapshots/1af89bab-13c8-467f-bf18-530824749694 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:00:04.904265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:04.908384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5ba06b73-187f-43ed-8bb7-272b16c90ef4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3870487b80>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:04.908667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8bfd93e-4ec6-4cb8-9620-1abfb2cbba09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.211309 Jun 29 10:00:04.909578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 129/256] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:04 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:04.974956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5ba06b73-187f-43ed-8bb7-272b16c90ef4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 202 len: 0 microversion: 2.1 time: 0.070431 Jun 29 10:00:04.975533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 128/257] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:00:04 2022] DELETE /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:00:04.984628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ed60dd09-6829-422c-bff4-79a40c338435 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3870493040>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:05.036734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ed60dd09-6829-422c-bff4-79a40c338435 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 200 len: 344 microversion: 2.1 time: 0.056398 Jun 29 10:00:05.037346 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 130/258] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:00:04 2022] GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:05.104353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:05.105095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:05.111771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:05.112671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:05.113554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:05.113991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:05.262902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:05.271351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-29663d34-a2bf-4905-886a-b2b86627c630 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.170830 Jun 29 10:00:05.272021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 129/259] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:05 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:05.927489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:05.928116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:05.934589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:05.935643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:05.936481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:05.936920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:06.060849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5d9aebf-b86f-4286-9521-3e3cfd77ec58 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f3870531b80>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:06.088342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:06.094118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-f5d9aebf-b86f-4286-9521-3e3cfd77ec58 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] HTTP exception thrown: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5d9aebf-b86f-4286-9521-3e3cfd77ec58 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Request method failure captured: Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc HTTP/1.1 Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCKdHNfTAmQkjOwbCbEcwHiA5W3KiLoBN6Hp_vaBTG0KFPTXrtSEyqvi3SkR5ch3uzJ8bn3vAY27WJfQ9FZrlK0f-Xl4FINSpOoBg1M_J6ZSgSL6m6_KEJWD-ZFfidBqqDXzkAPZPydt8LL40pP7LDFZOGvi8KwYnt9BXZREU209yZs Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:00:06.097015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08d103b7e2db492691cda72117de6142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08d103b7e2db492691cda72117de6142"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 587c22b1c33649119b6c9bfa5f77121a Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '71da76bb-10d2-4c5d-b516-aa17ae2cf0cc'} Jun 29 10:00:06.098554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. (HTTP 404) (Request-ID: req-47ee905b-c0f1-4b5e-b816-2f357c6652ec) Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.099503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:00:06.100794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 10:00:06.102596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.104420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.108110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78ac75cc-a18e-4e16-93c6-8bb8ebb9f2cc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1521 microversion: 2.1 time: 0.174256 Jun 29 10:00:06.108237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5d9aebf-b86f-4286-9521-3e3cfd77ec58 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Returning 404 to user: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:00:06.108237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f5d9aebf-b86f-4286-9521-3e3cfd77ec58 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 404 len: 109 microversion: 2.1 time: 0.051304 Jun 29 10:00:06.108237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 130/260] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:00:06 2022] GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:00:06.108591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 131/261] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:05 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:06.116867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8ad8dc51-ce62-4d89-82ae-e176f948d09a tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f387075c8b0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:06.147711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-8ad8dc51-ce62-4d89-82ae-e176f948d09a tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] HTTP exception thrown: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8ad8dc51-ce62-4d89-82ae-e176f948d09a tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Request method failure captured: Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc HTTP/1.1 Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCKdHNfTAmQkjOwbCbEcwHiA5W3KiLoBN6Hp_vaBTG0KFPTXrtSEyqvi3SkR5ch3uzJ8bn3vAY27WJfQ9FZrlK0f-Xl4FINSpOoBg1M_J6ZSgSL6m6_KEJWD-ZFfidBqqDXzkAPZPydt8LL40pP7LDFZOGvi8KwYnt9BXZREU209yZs Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:00:06.149707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08d103b7e2db492691cda72117de6142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08d103b7e2db492691cda72117de6142"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 587c22b1c33649119b6c9bfa5f77121a Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '71da76bb-10d2-4c5d-b516-aa17ae2cf0cc'} Jun 29 10:00:06.150959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. (HTTP 404) (Request-ID: req-c3b6385c-24e5-441d-a49e-e3aa1a5d55aa) Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.151735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 10:00:06.153183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 10:00:06.154942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8ad8dc51-ce62-4d89-82ae-e176f948d09a tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Returning 404 to user: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8ad8dc51-ce62-4d89-82ae-e176f948d09a tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 404 len: 109 microversion: 2.1 time: 0.038448 Jun 29 10:00:06.156626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 131/262] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:00:06 2022] DELETE /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:00:06.161114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11ce63a6-bc16-49ac-8797-8fe4d438b9c4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Calling method '.version_select at 0x7f387049b790>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:06.174541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:06.195755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-11ce63a6-bc16-49ac-8797-8fe4d438b9c4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] HTTP exception thrown: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11ce63a6-bc16-49ac-8797-8fe4d438b9c4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Request method failure captured: Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc HTTP/1.1 Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCKdHNfTAmQkjOwbCbEcwHiA5W3KiLoBN6Hp_vaBTG0KFPTXrtSEyqvi3SkR5ch3uzJ8bn3vAY27WJfQ9FZrlK0f-Xl4FINSpOoBg1M_J6ZSgSL6m6_KEJWD-ZFfidBqqDXzkAPZPydt8LL40pP7LDFZOGvi8KwYnt9BXZREU209yZs Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:00:06.197910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/08d103b7e2db492691cda72117de6142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/08d103b7e2db492691cda72117de6142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_08d103b7e2db492691cda72117de6142"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 08d103b7e2db492691cda72117de6142 Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1860490224 Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 587c22b1c33649119b6c9bfa5f77121a Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1860490224-project Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '71da76bb-10d2-4c5d-b516-aa17ae2cf0cc'} Jun 29 10:00:06.199220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. (HTTP 404) (Request-ID: req-44cee5e2-1698-42bb-9416-df297bf54a9b) Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.199929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:00:06.200919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 10:00:06.202053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11ce63a6-bc16-49ac-8797-8fe4d438b9c4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] Returning 404 to user: Volume 71da76bb-10d2-4c5d-b516-aa17ae2cf0cc could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11ce63a6-bc16-49ac-8797-8fe4d438b9c4 tempest-VolumesSnapshotsTestJSON-1860490224 tempest-VolumesSnapshotsTestJSON-1860490224-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc" status: 404 len: 109 microversion: 2.1 time: 0.043553 Jun 29 10:00:06.203068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 132/263] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:00:06 2022] GET /compute/v2.1/os-volumes/71da76bb-10d2-4c5d-b516-aa17ae2cf0cc => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:00:06.290535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:06.291624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:06.298129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:06.298898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:06.299933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:06.300905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:06.472507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:06.481694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8e5d9a56-bcb8-4074-b1fd-e455055b93b1 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1314 microversion: 2.1 time: 0.196169 Jun 29 10:00:06.482641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 132/264] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:06 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:07.116665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:07.122485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:07.131506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:07.132504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:07.133960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:07.135096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:07.299541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:07.308561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08c522bf-1799-4377-9747-165c4582489d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1501 microversion: 2.1 time: 0.198779 Jun 29 10:00:07.310334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 133/265] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:07 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:07.329601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:07.331596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:07.339780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:07.340383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:07.341167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:07.341597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:07.499498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:07.500125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:07.502277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:07.507580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:07.508019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:07.508791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:07.509224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:07.510939 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bddb3652-2bee-441d-83bb-38b0b73cc7df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1515 microversion: 2.1 time: 0.186575 Jun 29 10:00:07.511693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 133/266] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:07 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:07.669042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:07.672926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:07.679200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77ea1ef7-978f-49c7-b178-1a56ea575d97 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1499 microversion: 2.1 time: 0.183984 Jun 29 10:00:07.679962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 134/267] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:07 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1499 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:08.407060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:08.407706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:08.414508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:08.414995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:08.415771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:08.416204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:08.446578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:00:08.520568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:08.521784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:08.531800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:08.532673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:08.533799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:08.534672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:08.586953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6873b0a5-30e7-4bfc-92d4-05b8652c4b84 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 204 len: 0 microversion: 2.1 time: 0.182628 Jun 29 10:00:08.588158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 134/268] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:00:08 2022] DELETE /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:00:08.598288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7fd24ade-8f37-4bb6-a62c-27de04ef1d03 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/ips" status: 200 len: 153 microversion: 2.20 time: 0.088238 Jun 29 10:00:08.599767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 135/269] 10.222.0.52 () {60 vars in 1288 bytes} [Wed Jun 29 10:00:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/ips => generated 153 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:00:08.600138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:08.601237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:08.624206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:08.625179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:08.626168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:08.638230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:08.801843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:08.811448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-109e5ba9-f00c-4e4d-957e-67a06374dece tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1505 microversion: 2.1 time: 0.216579 Jun 29 10:00:08.812283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 135/270] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:08 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:09.059999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:09.061101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:09.068513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:09.068772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:09.069447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:09.070222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:09.101231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'flavor' on Instance uuid 1120efe8-bc65-4df7-88b6-91c5a05e0df6 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:00:09.222172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-becac6a7-4f9e-4db6-8ae1-26028b014bd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/action" status: 200 len: 32 microversion: 2.1 time: 0.176042 Jun 29 10:00:09.223350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 136/271] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:00:09 2022] POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 10:00:09.241532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:09.242316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:09.248928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:09.249405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:09.250186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:09.250655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:09.410024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:09.419453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3784bbf1-f111-4320-9b06-e3ccd1e3d04c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.186108 Jun 29 10:00:09.420059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 136/272] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:09 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:09.831926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:09.832744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:09.839799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:09.840217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:09.841205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:09.841614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:09.988044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:09.999042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69b17397-c65e-41a5-afaf-b7ba58ab5566 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1505 microversion: 2.1 time: 0.171883 Jun 29 10:00:10.000190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 137/273] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:09 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:10.437943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:10.439352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:10.454416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:10.455448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:10.456834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:10.457382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:10.903556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:10.904857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:10.911424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:10.911868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:10.912639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:10.913068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:10.930919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:10.941014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1478e44-5cd7-43ed-9ccf-795694037427 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.507800 Jun 29 10:00:10.947030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 137/274] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:10 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:10.952920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lazy-loading 'flavor' on Instance uuid 18247887-76cd-4d14-b694-3aaa572ca574 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:00:11.020012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:11.020924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:11.033523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.034379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:11.035448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.036236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:11.340738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2714f3c2-4021-4915-9d83-0322b92d876d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/action" status: 202 len: 0 microversion: 2.20 time: 0.441597 Jun 29 10:00:11.359198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 138/275] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 10:00:10 2022] POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:00:11.370344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:11.371468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:11.379654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.380540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:11.381730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.382536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:11.515059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1694bd50d03f4d0f9c2ccee1b0775e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c61e1258f5d44ba903a0132415437c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:11.537125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2fc5dfc0-d562-46c2-ab20-6672748cfbec tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 200 len: 1505 microversion: 2.1 time: 0.524783 Jun 29 10:00:11.538873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 138/276] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:11 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:11.780032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:11.788527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-63832006-8686-48a7-8c18-e540f3421ad3 req-957a1bcf-bea0-488f-9366-20740cb0f312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47807f8-7fbd-4c57-a732-7652921aae81", "name": "network-vif-deleted", "tag": "6fc71e28-031a-4091-ac84-2da3085eb61c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:11.792097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:11.794104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:11.795647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-840ed26d-f05f-4179-804a-c17578e57cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.434685 Jun 29 10:00:11.796497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 139/277] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:11.815944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-63832006-8686-48a7-8c18-e540f3421ad3 req-957a1bcf-bea0-488f-9366-20740cb0f312 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.816304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-63832006-8686-48a7-8c18-e540f3421ad3 req-957a1bcf-bea0-488f-9366-20740cb0f312 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:11.853129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-63832006-8686-48a7-8c18-e540f3421ad3 req-957a1bcf-bea0-488f-9366-20740cb0f312 service nova] Creating event network-vif-deleted:6fc71e28-031a-4091-ac84-2da3085eb61c for instance f47807f8-7fbd-4c57-a732-7652921aae81 on hv-cinder-76810 Jun 29 10:00:11.872879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-63832006-8686-48a7-8c18-e540f3421ad3 req-957a1bcf-bea0-488f-9366-20740cb0f312 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078063 Jun 29 10:00:11.874175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 139/278] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:00:11.964620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:11.965422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:11.973342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.974056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:11.975153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:11.976038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:12.226536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:12.234650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-063ed25c-8d65-4ee3-bc84-9791b364839a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.274264 Jun 29 10:00:12.235261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 140/279] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:11 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:12.254840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:12.257362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:12.264670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:12.265538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:12.266426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:12.266884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:12.302963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f5267f0c-fe8e-4305-8ecf-e605ab725152 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/ips" status: 200 len: 150 microversion: 2.1 time: 0.053956 Jun 29 10:00:12.304340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 140/280] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:00:12 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:00:12.554781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:12.555420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] [instance: f47807f8-7fbd-4c57-a732-7652921aae81] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:12.566854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:12.567802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:12.568955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:12.569658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:12.589341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] HTTP exception thrown: Instance f47807f8-7fbd-4c57-a732-7652921aae81 could not be found. Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Request method failure captured: Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 HTTP/1.1 Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJ_nerEpZBxePxzAsbLuHIxTcj5RXhKZtizRWKU_XWrYzpoclZeU9SyyaJjAMF08OCXSlexYbGWSw3yG5bfoer8DCufgiqK96uAs7vSJfN7jXIuWF0Z-m30Q_TleAmoYZu89VIpU8DJnHtGqsqHtTudW4vf3pUpsYX7xarwHl7U-Lk Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 5c61e1258f5d44ba903a0132415437c6 Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesActionsTest-1165164319 Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:00:12.594593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c61e1258f5d44ba903a0132415437c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesActionsTest-1165164319 Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 5c61e1258f5d44ba903a0132415437c6 Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesActionsTest-1165164319 Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesActionsTest-1165164319-project Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 1694bd50d03f4d0f9c2ccee1b0775e12 Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesActionsTest-1165164319-project Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance f47807f8-7fbd-4c57-a732-7652921aae81 could not be found. Jun 29 10:00:12.595883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': 'f47807f8-7fbd-4c57-a732-7652921aae81'} Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47807f8-7fbd-4c57-a732-7652921aae81 could not be found. Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:00:12.598005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47807f8-7fbd-4c57-a732-7652921aae81 could not be found. Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47807f8-7fbd-4c57-a732-7652921aae81 could not be found. Jun 29 10:00:12.599572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:00:12.601817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] Returning 404 to user: Instance f47807f8-7fbd-4c57-a732-7652921aae81 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:00:12.602796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-868c966a-3bf2-4d0e-aa58-c25804dcb699 tempest-VolumesActionsTest-1165164319 tempest-VolumesActionsTest-1165164319-project] 10.222.0.52 "GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81" status: 404 len: 111 microversion: 2.1 time: 0.052176 Jun 29 10:00:12.608811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 141/281] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:12 2022] GET /compute/v2.1/servers/f47807f8-7fbd-4c57-a732-7652921aae81 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:00:12.815418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:12.816866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:12.827336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:12.829427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:12.832498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:12.834388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:13.047571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:13.067328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:13.069534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:13.071105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5689729d-4105-400f-a131-840b00c499ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.259591 Jun 29 10:00:13.072352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 141/282] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:13.256273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:13.257609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:13.265834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:13.266746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:13.267796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:13.268487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:13.504908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:13.538500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25895a89-9a2b-4c43-8ca0-ee6c4d174e02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.288670 Jun 29 10:00:13.539856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 142/283] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:13 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:13.875159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db304a1d-daff-474d-802f-bdf4dad75786"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:13.877760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:13.889888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:13.891054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:13.892444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:13.893602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:14.098143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:14.099650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:14.106214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:14.106818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:14.107688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:14.108339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:14.275949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:14.293680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:14.295226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:14.296611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7960d62-0266-4463-a0e0-1ec977444edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.203284 Jun 29 10:00:14.297172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 143/284] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:14.566902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:14.568287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:14.577543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:14.579668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:14.580803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:14.581618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:14.755704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:14.764396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ecad2950-e94d-499d-9f73-5ab1f4736f26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.204883 Jun 29 10:00:14.765184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 144/285] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:14 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:15.318016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:15.318610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:15.326456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:15.326900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:15.327671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:15.328097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:15.627775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:15.636406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:15.637906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:15.639242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7a564732-f010-480c-b991-dcfcf0acb2bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.325786 Jun 29 10:00:15.639778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 145/286] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:15.781125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:15.781737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:15.787822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:15.788268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:15.789030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:15.789456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:15.939988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:15.947861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a292f162-c72e-419d-9869-6df882655b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.170536 Jun 29 10:00:15.948422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 146/287] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:15 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:16.657017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:16.657686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:16.663963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:16.664408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:16.665187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:16.665687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:16.814257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:16.823945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:16.825734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:16.827013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15cef3e0-3a09-400a-9801-41235152f209 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.173726 Jun 29 10:00:16.832792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 147/288] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:16.966227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:16.966868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:16.973559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:16.974084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:16.974918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:16.975493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:16.995920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:17.008084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:17.029151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a0df5041-78e4-41ee-bbe8-39f882114766 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.162507 Jun 29 10:00:17.029916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 142/289] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:00:13 2022] POST /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments => generated 194 bytes in 3164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:17.128309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:17.139348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a7e1b1b3-5746-4e4e-ab82-f9ae9e3065b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.177797 Jun 29 10:00:17.149245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 148/290] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:16 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:17.854118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:17.855159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:17.864766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:17.865191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:17.865963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:17.866398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:18.013335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:18.021973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:18.023512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:18.024696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef3ba4a4-ac11-4f83-855e-b61d12a229ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.176303 Jun 29 10:00:18.025252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 143/291] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:18.157033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:18.157881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:18.165298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:18.165677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:18.166469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:18.167700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:18.310199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:18.318701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5e45093-c05f-4e21-87a0-0c2ae427a5a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.165492 Jun 29 10:00:18.319280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 149/292] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:18 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:19.043248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:19.043946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:19.051319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:19.051780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:19.052559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:19.053003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:19.192820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:19.201204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:19.202726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:19.203883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-65d5265f-02ed-4fab-aa1a-6c568c9a7e6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.164643 Jun 29 10:00:19.204410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 144/293] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:19.337289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:19.337896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:19.344605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:19.345075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:19.345814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:19.346244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:19.496723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:19.504812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd822b33-89bb-464c-8a2c-53a2e645fafb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.172064 Jun 29 10:00:19.505381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 150/294] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:19 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:20.223163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:20.223739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:20.230840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:20.231378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:20.232033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:20.232493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:20.374751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:20.387439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:20.389769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:20.391589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6b174460-439d-4e68-810d-5c5e5a5e5db1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.172579 Jun 29 10:00:20.392388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 145/295] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:20.523724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:20.524564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:20.533016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:20.533616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:20.534703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:20.535367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:20.681025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:20.688947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0620b14c-ed3f-4b56-8637-a33bd5612ab0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.170585 Jun 29 10:00:20.689517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 151/296] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:20 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:21.409606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:21.411071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:21.415632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:21.420104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:21.420621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:21.421303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:21.421738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:21.584557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:21.597090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:21.598613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:21.599859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a6417505-cd09-4ee9-abac-88ade621aed7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.194418 Jun 29 10:00:21.611707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 146/297] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:21.705389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:21.705985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:21.712939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:21.713389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:21.714177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:21.714610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:21.861277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:21.870046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8e2009dc-c55a-4042-b982-596528d9a99e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.168511 Jun 29 10:00:21.880101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 152/298] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:21 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:22.635994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:22.637341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:22.644742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:22.645729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:22.646856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:22.647596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:22.890647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:22.892458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:22.911077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:22.912225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:22.913550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:22.914191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:22.950418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:22.960147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:22.967633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:22.968892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c2cbae81-46a0-43ae-9bc1-9df42c0b1a2d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.337850 Jun 29 10:00:22.975361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 147/299] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:23.155658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:23.165034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c65a5c4-8445-4aa2-be58-ed318bb0ede1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.279475 Jun 29 10:00:23.165934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 153/300] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:22 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:23.988263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:23.989147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:24.000312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:24.001039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:24.001998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:24.002427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:24.184191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:24.184827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:24.204319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:24.217941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:24.226628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:24.227690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:24.229602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:24.230461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:24.230933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a17b1bd-34da-4165-b4fd-776c883b02ec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.247223 Jun 29 10:00:24.234625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:24.234814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 148/301] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:24.234942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:24.439582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:24.456676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa31db40-2467-42a7-89ff-967804c025bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.277544 Jun 29 10:00:24.461644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 154/302] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:24 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:25.249471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:25.250094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:25.259082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:25.259543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:25.260356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:25.260792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:25.455557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:25.482019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:25.483336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:25.489838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:25.490966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:25.491592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:25.492827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:25.493483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:25.493722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:25.497028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e6b0e320-8dde-468c-8f15-562645b1c8e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.249493 Jun 29 10:00:25.498064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 149/303] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:25.681972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:25.695290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5192f1e-1ab8-4aff-9171-e66ad06b26c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.216339 Jun 29 10:00:25.696698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 155/304] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:25 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:26.532360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:26.535390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:26.556713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:26.558235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:26.560018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:26.561453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:26.718149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:26.719049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:26.738433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:26.741622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:26.753008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:26.753755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:26.858595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:26.870546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:26.872147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:26.873421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b1fabe53-0d5e-4c86-a22b-c4e7858f147b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.358465 Jun 29 10:00:26.873996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 150/305] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:27.029988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:27.038924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ffa2de0c-3288-4efc-bca8-297cbae7afdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.328955 Jun 29 10:00:27.039779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 156/306] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:26 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:27.900824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:27.901718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:27.954769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:27.960340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:27.962678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15a908d2-4493-4c69-9fb7-9b2f55bc07d1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: .version_select at 0x7f3870592a60>, body: {"keypair": {"name": "tempest-keypair-755911790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVl731oqnqNfgyHMkXsimp9tAfCxr8eDu/1rojr8tPAO/9k7zOqHpwHTqe2SiPcKkMLw0Ax+eGDM8H34BWby/YEr2q6YvX3tI0IPEJExTqP4s2TnaaFdoFOLtwylfkMew=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:27.965199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:27.967286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:28.007795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-15a908d2-4493-4c69-9fb7-9b2f55bc07d1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:00:28.016533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-15a908d2-4493-4c69-9fb7-9b2f55bc07d1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:00:28.076173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15a908d2-4493-4c69-9fb7-9b2f55bc07d1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136449 Jun 29 10:00:28.076768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 157/307] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:00:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:28.087259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:28.087876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:28.098262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:28.098751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:28.099525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:28.103729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:28.665283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:28.691862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:28.693531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:28.694818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-764cf16c-00a0-40f0-8f01-a366e2ef3eb3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.804775 Jun 29 10:00:28.696404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 151/308] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:28.757296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:28.816527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f73f06ce-3940-4a17-ab83-1d72f624686e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.732359 Jun 29 10:00:28.817388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 158/309] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:28 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:28.891989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1267280151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-698110575", "security_groups": [{"name": "tempest-secgroup-smoke-1483186916"}], "block_device_mapping_v2": [{"uuid": "68f08d03-e9ee-40e8-85e0-7582bbe747ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4eae6fbf-3414-4d08-88dd-e97fd883b29c"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:29.260402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] validate_networks() for [('4eae6fbf-3414-4d08-88dd-e97fd883b29c', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:00:29.718230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:29.719721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:29.733823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:29.734960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:29.736412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:29.738354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:30.095854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:00:30.096366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:00:30.096909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:00:30.097391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:00:30.097913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:00:30.108016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:30.109693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:30.110814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:30.111546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:30.132252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Getting quotas for project 0192e4102b644993a9482674674b1ad7. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:00:30.138140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Getting quotas for user 48ff681e601f4892abffe5862def0547 and project 0192e4102b644993a9482674674b1ad7. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:00:30.196353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:30.206270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:30.212977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:30.215716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-94a70659-5b07-47ac-9cbf-597bc3c937df tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.502433 Jun 29 10:00:30.216464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:00:30.218840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68f08d03-e9ee-40e8-85e0-7582bbe747ad',volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:00:30.230768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 159/310] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:30.235808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:30.240974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:30.257086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:30.257606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:30.259337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:30.259337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:30.451984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cfeef41a-1dbf-45d5-bde7-bfa16d87337c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.558030 Jun 29 10:00:30.453115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 152/311] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:00:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:00:30.470586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8702a845-27d7-4099-acb2-9eedb73d3571 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:30.471712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8702a845-27d7-4099-acb2-9eedb73d3571 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:30.594040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8702a845-27d7-4099-acb2-9eedb73d3571 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:30.603464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8702a845-27d7-4099-acb2-9eedb73d3571 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1094 microversion: 2.1 time: 0.143355 Jun 29 10:00:30.604072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 153/312] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:30 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1094 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:30.680575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:30.692558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b489855d-d41c-47cd-bdcb-4ec1f98f023c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.460517 Jun 29 10:00:30.693458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 160/313] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:30 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:31.237588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:31.238300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:31.246945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1732089662", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8656fd5-64f6-4a7e-ad73-3f1c4df65b17"}], "security_groups": [{"name": "tempest-securitygroup--651415407"}], "key_name": "tempest-keypair-755911790", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:31.247545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:31.247644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:31.248412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:31.248848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:31.441861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:31.460143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:31.463349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:31.464900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0d9207cd-eb77-44fc-8381-ae5a1d8c6e91 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.231576 Jun 29 10:00:31.465749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 154/314] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:31.622156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:31.623249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:31.630747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:31.631288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:31.632203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:31.633047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:31.713671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:31.721817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d559d0b6-b06d-402b-9148-13c00f89a304 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1192 microversion: 2.1 time: 0.104645 Jun 29 10:00:31.722840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 155/315] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:31 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:31.736035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:31.736916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:31.745684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:31.746674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:31.747681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:31.748395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:31.904286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:31.912306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91b5c080-f202-4dcd-af07-8e55f6c937a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.188321 Jun 29 10:00:31.913100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 156/316] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:31 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:32.491245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:32.492023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:32.499811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:32.500264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:32.501066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:32.501679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:32.664164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:32.674202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:32.676239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:32.678396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e96ae379-2c7c-40b6-828a-9a9fad5cb847 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.194841 Jun 29 10:00:32.679250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 157/317] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:32.740778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:32.741846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:32.749581 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:32.750025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:32.751137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:32.752009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:32.829323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:32.841297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-32e73253-7b39-48cb-afaa-6f85d25de879 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1192 microversion: 2.1 time: 0.105219 Jun 29 10:00:32.842233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 158/318] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:32 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:32.939026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:32.939026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:32.940810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:32.940810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:32.941260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:32.941518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:33.163021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:33.172272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-539c45f8-133e-4750-a2a3-9fe717b5afcb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.245762 Jun 29 10:00:33.173198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 159/319] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:32 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:33.699657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:33.701295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:33.708750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:33.709505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:33.710286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:33.710876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:33.738540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:33.885913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:33.894492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:33.896032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:33.897433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e75d01bb-ace6-49fb-b308-dcb24eefeb37 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.201787 Jun 29 10:00:33.898064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 160/320] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:33.903311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:33.903926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:33.910556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:33.911045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:33.911828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:33.912332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:33.995447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:34.004446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-16f3558b-e682-4292-a67a-e2b148d9451d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1192 microversion: 2.1 time: 0.105237 Jun 29 10:00:34.005308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 161/321] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:33 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:34.190771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:34.191369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:34.198663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:34.199083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:34.200137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:34.200265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:34.385050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:34.395683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-454bf6c3-1c48-459e-84b5-9e79c174fa65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.208523 Jun 29 10:00:34.406177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 162/322] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:34 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:34.929183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:34.930112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:34.948831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:34.951687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:34.953473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:34.954138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:35.387232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:35.398059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:35.401580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:35.405448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e8fa8bb7-9174-427f-97a2-a2a9af35d237 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.485066 Jun 29 10:00:35.407998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 163/323] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:35.422447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:35.428825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:35.453890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:35.456745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:35.457896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:35.459450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:35.608453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:35.618880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-50bcdba1-0fca-4077-87d6-a2d5ea9120cd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1210 microversion: 2.1 time: 0.210571 Jun 29 10:00:35.619893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 164/324] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:35 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:35.624892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:35.625723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:35.633338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:35.634414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:35.635248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:35.635690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:35.892084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:35.907187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4b2e766f-fe6c-4992-8e1b-cd09a06b1104 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.283406 Jun 29 10:00:35.908079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 165/325] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:35 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:36.427701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:36.430264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:36.443151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:36.444137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:36.445588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:36.446215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:36.752781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:36.763551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:36.765191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:36.766465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bc1cad20-6cf0-47d3-a958-3009c7b2c825 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.344902 Jun 29 10:00:36.767701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 166/326] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:36.774530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:36.775480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:36.785491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:36.785964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:36.787263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:36.805753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:37.074621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:37.086762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-83f2421b-e6c4-4adb-94b8-923004184b81 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.315869 Jun 29 10:00:37.087577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 167/327] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:36 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:37.094688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:37.095927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:37.105798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:37.106246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:37.107517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:37.110736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:37.501017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:37.515217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-24bf6a85-957a-48ed-a513-215f6862b312 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.426205 Jun 29 10:00:37.516260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 168/328] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:37 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:37.521651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-f806f83e-c301-4920-b9ba-e4323ab03b1b req-59bd089c-af0e-403b-b606-22cabc12a5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bac0f78-62e4-4cd7-a3c4-5db0831d274b", "tag": "1927ed3c-4a6c-4cd4-980d-0f750cc50d93"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:37.579983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f806f83e-c301-4920-b9ba-e4323ab03b1b req-59bd089c-af0e-403b-b606-22cabc12a5bc service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:37.580457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f806f83e-c301-4920-b9ba-e4323ab03b1b req-59bd089c-af0e-403b-b606-22cabc12a5bc service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:37.641122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-f806f83e-c301-4920-b9ba-e4323ab03b1b req-59bd089c-af0e-403b-b606-22cabc12a5bc service nova] Creating event network-changed:1927ed3c-4a6c-4cd4-980d-0f750cc50d93 for instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b on hv-cinder-76810 Jun 29 10:00:37.661228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-f806f83e-c301-4920-b9ba-e4323ab03b1b req-59bd089c-af0e-403b-b606-22cabc12a5bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143581 Jun 29 10:00:37.662150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 169/329] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:37.789447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:37.790854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:37.799994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:37.801111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:37.802237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:37.803031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:38.041420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:38.190213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:38.199872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:38.201486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:38.202940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8411885a-d823-4284-a69f-bf27d68c3048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.419549 Jun 29 10:00:38.203730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 170/330] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:38.220390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:38.221011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:38.229300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:38.229775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:38.230582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:38.231401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:38.378016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:38.386905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e3df84a0-0e17-4af4-993e-da438d1618d6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.170321 Jun 29 10:00:38.387464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 171/331] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:38.534416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:38.535376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:38.542663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:38.543598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:38.544677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:38.545312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:39.097202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:39.109360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9dbd54f8-1752-4637-b86c-99fb8c827b11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.579446 Jun 29 10:00:39.110297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 172/332] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:38 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:39.227274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:39.228570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:39.243932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:39.244813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:39.246783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:39.247719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:39.520487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:39.530471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:39.533793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:39.535287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-db5a8a23-e6bc-4142-a663-c70deaa7f708 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1724 microversion: 2.20 time: 0.314923 Jun 29 10:00:39.535949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 173/333] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:39.555452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:39.557919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:39.567397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:39.568896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:39.569954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:39.570677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:39.779905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:39.793863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7b4f0ed-9bf5-4ed0-8b57-4effa09a9913 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.256600 Jun 29 10:00:39.806973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 174/334] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:39 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:40.129538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:40.130162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:40.132335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:40.139525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:40.139957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:40.140743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:40.141282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:40.343549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:40.354762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ac1561cf-e04e-435e-940a-e7b318309b5b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.228988 Jun 29 10:00:40.365538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 175/335] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:40 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:40.559959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:40.560752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:40.568569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:40.569079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:40.569808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:40.570458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:40.612113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=8 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:40.686360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=68 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:40.763314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:40.782033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:40.784710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:40.786165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-72c88a61-eaf5-49a5-ba47-9aa38da247f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1745 microversion: 2.20 time: 0.234075 Jun 29 10:00:40.786969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 176/336] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1745 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:40.814151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:40.814806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:40.821833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:40.822427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:40.823399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:40.823976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:41.024453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:41.028650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:41.034464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a3652351-f789-4502-a2f5-37d6e7edceb9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.226361 Jun 29 10:00:41.035140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 177/337] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:40 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:41.260564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:41.373467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:41.373976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:41.381587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:41.382015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:41.384368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:41.384808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:41.557036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:41.565706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bc07033b-25b3-4926-b7a2-2a3f2390da45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.196164 Jun 29 10:00:41.566425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 178/338] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:41 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:41.807475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:41.808504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:41.815183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:41.815731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:41.816588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:41.817275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:42.135683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:42.146348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:42.154260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:42.159692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1d7885e0-d7c0-425b-a1d3-0fe736d92514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1745 microversion: 2.20 time: 0.352507 Jun 29 10:00:42.162654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 179/339] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1745 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:42.187802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:42.188631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:42.200712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:42.201534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:42.202557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:42.203832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:42.391269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:42.405011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a5439bde-b31e-4294-adb6-403ea1792ea1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.239095 Jun 29 10:00:42.406636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 180/340] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:42 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:42.584108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:42.585106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:42.597289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:42.598445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:42.600406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:42.602412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:42.971033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:42.979669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a2e8d294-b87e-4205-9466-9ab807d3825f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.400283 Jun 29 10:00:42.987311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 181/341] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:42 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:43.186621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:43.187248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:43.198016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:43.199333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:43.200300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:43.201380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:43.536462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:43.567035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:43.569094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:43.571339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8811b4ea-e8d0-47d5-bb29-03fd725f6d26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.388434 Jun 29 10:00:43.584607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 182/342] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:43.597479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:43.602961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:43.625016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:43.663018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:43.670692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:43.674986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:44.054189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:44.062759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-136fbff8-0768-4cb6-8847-28315a98c19d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.474803 Jun 29 10:00:44.068677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 183/343] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:43 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:44.074462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:44.075395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:44.083788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:44.084786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:44.086329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:44.087305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:44.443727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:44.462735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9f9f060b-5263-4964-a8a6-96e4b76e716e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.392661 Jun 29 10:00:44.463334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 184/344] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:44 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:44.593824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:44.595965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:44.607280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:44.610950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:44.612307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:44.612945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:44.889814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:44.899058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:44.900616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:44.902040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-87d8d5a1-6714-4dc0-9ba5-68701b72a699 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.314299 Jun 29 10:00:44.918054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 185/345] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:44.926508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-54bbd080-d84a-4ce5-8986-e7ce177f9660 req-f0ac12a7-9922-4a90-be25-0b9469f2188f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "name": "network-vif-plugged", "status": "completed", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:44.941318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-54bbd080-d84a-4ce5-8986-e7ce177f9660 req-f0ac12a7-9922-4a90-be25-0b9469f2188f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:44.941603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-54bbd080-d84a-4ce5-8986-e7ce177f9660 req-f0ac12a7-9922-4a90-be25-0b9469f2188f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:44.957082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-54bbd080-d84a-4ce5-8986-e7ce177f9660 req-f0ac12a7-9922-4a90-be25-0b9469f2188f service nova] Creating event network-vif-plugged:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 10:00:44.964078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-54bbd080-d84a-4ce5-8986-e7ce177f9660 req-f0ac12a7-9922-4a90-be25-0b9469f2188f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042557 Jun 29 10:00:44.965298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 186/346] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:45.083306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:45.083802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:45.090159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:45.098959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:45.099408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:45.113480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:45.114474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:45.425100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] validate_networks() for [('e8656fd5-64f6-4a7e-ad73-3f1c4df65b17', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:00:45.654748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:45.662405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d5224bf9-6f05-4af7-ad35-1f927a579be8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.585542 Jun 29 10:00:45.663105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 187/347] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:45 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:45.673545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:45.674832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:45.684184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:45.684629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:45.685654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:45.686255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:45.846384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:45.862198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f7f212e1-8bfb-4200-aede-9179eb97f5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.196866 Jun 29 10:00:45.863100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 188/348] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:45 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:45.921066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:45.921681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:45.930608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:45.931066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:45.932041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:45.933378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:46.106742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:46.116403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:46.118674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:46.120070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-af2b920c-b982-40f9-b914-4629a0068f96 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.203498 Jun 29 10:00:46.120602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 189/349] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:46.405756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:00:46.406761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:00:46.407784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:00:46.409093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:00:46.410992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:00:46.452170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:46.454883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:46.458467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:46.459089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:46.496456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:00:46.506157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:00:46.533245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:00:46.536318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:00:46.610129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6dc39b68-7de7-4bc7-bfbf-73f1352f6140 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 15.369222 Jun 29 10:00:46.611409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 161/350] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:00:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 15371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:00:46.624916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4ac79556-93c0-46f3-b492-ff182d4b51e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:46.625916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4ac79556-93c0-46f3-b492-ff182d4b51e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:46.681102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:46.681828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:46.698485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:46.698967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:46.699761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:46.700198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:46.776421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4ac79556-93c0-46f3-b492-ff182d4b51e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:46.792960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4ac79556-93c0-46f3-b492-ff182d4b51e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1241 microversion: 2.1 time: 0.169619 Jun 29 10:00:46.794742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 190/351] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:46 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1241 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:46.882911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:46.883932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:46.890547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:46.891023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:46.891979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:46.892409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:47.213313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:47.229434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8ba19b61-b5aa-430c-b95c-0a6d06416d73 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.353153 Jun 29 10:00:47.250362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 191/352] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:46 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:47.268704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:47.271726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:47.288884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:47.308942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:47.316713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:47.317363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:47.331712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:47.341211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6d82c29-608c-4e43-9316-beb479b8aefa tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.665526 Jun 29 10:00:47.351218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 162/353] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:46 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:47.766684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:47.803283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:47.811083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:47.811858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:47.812650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:47.816428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80468ae8-27a8-4b23-9eb7-a0e0bb7201e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.563218 Jun 29 10:00:47.817796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 192/354] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:47.827021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:47.827587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:47.828715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:47.829299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:48.006345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:48.022531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae7a3af5-93e2-4348-9c3d-a82ea2452245 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1245 microversion: 2.1 time: 0.214897 Jun 29 10:00:48.028916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 163/355] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:47 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1245 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:48.255294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:48.256335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:48.268063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:48.268745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:48.270165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:48.270830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:48.361873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:48.363705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:48.375673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:48.376526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:48.380114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:48.380891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:48.617580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:48.628394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b9796b83-348c-4783-923a-8445a091afef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.383808 Jun 29 10:00:48.628957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 193/356] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:48 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:48.834914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:48.836138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:48.855685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:48.856639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:48.858016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:48.858649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:49.076802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:49.095009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-695b4e2f-901d-41fd-b499-f29613a989ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.741109 Jun 29 10:00:49.095606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 164/357] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:48 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:49.115165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:49.128693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:49.153458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:49.153927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:49.154775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:49.155212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:49.315833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:49.328276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-46b17196-c7a4-439a-9865-93b9fca63881 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1301 microversion: 2.1 time: 0.221601 Jun 29 10:00:49.329070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 165/358] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:49 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1301 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:49.452508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:49.469282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:49.471065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:49.477958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-107d2891-d0cf-48dc-a914-6a66dc5203cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.646939 Jun 29 10:00:49.478894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 194/359] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:49.648649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:49.649866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:49.659239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:49.667733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:49.669767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:49.671966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:49.958633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:49.967740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1bc6f99-fd22-4239-8754-6ce36588f6f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1501 microversion: 2.1 time: 0.326289 Jun 29 10:00:49.984827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 166/360] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:49 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1501 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:49.993027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72cd6f63-212e-44c3-9047-c0868ed067ea"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:49.994174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:50.002100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.002551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.003349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.007611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.067216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Cannot 'attach_volume' instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 while it is in vm_state rescued Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/os-volume_attachments HTTP/1.1 Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 74 Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:00:50.068901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {"volumeAttachment": {"volumeId": "72cd6f63-212e-44c3-9047-c0868ed067ea"}} Jun 29 10:00:50.070469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Cannot 'attach_volume' instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 while it is in vm_state rescued Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '1120efe8-bc65-4df7-88b6-91c5a05e0df6', 'body': {'volumeAttachment': {'volumeId': '72cd6f63-212e-44c3-9047-c0868ed067ea'}}} Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:00:50.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 while it is in vm_state rescued Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:00:50.072698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:00:50.073827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:00:50.073827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:00:50.073827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 while it is in vm_state rescued Jun 29 10:00:50.073827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:00:50.074970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 409 to user: Cannot 'attach_volume' instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 while it is in vm_state rescued {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:00:50.075988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d161d0a6-8333-41bd-a620-eb002e4153ce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087770 Jun 29 10:00:50.077035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 195/361] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:00:49 2022] POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 10:00:50.087139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:50.089534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:50.099016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.099802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.100846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.101740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.112822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:50.113775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:50.129539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.130368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.131454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.132663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.172626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:50.237408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50507650-adda-430e-8c6c-8cfd92916bdb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/action" status: 202 len: 0 microversion: 2.1 time: 0.155529 Jun 29 10:00:50.238342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 167/362] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:00:50 2022] POST /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:00:50.250764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:50.257403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:50.270536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.271370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.272476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.273234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.648377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:50.657498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd32424e-cd53-42bf-86cb-02875e56e6dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1509 microversion: 2.1 time: 0.413799 Jun 29 10:00:50.661643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 168/363] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:50 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:50.670293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:50.674768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:50.685603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.686526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.687478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.688053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.894680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:50.905355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-edc12196-05cf-4bae-8647-ff506d044453 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1299 microversion: 2.1 time: 0.242448 Jun 29 10:00:50.919160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 169/364] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:50 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:50.934424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:50.936279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:50.955472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.956784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:50.957771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:50.959609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:51.044509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:51.059917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-789e9a2c-39ee-446d-8051-66990f9dab33 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.947127 Jun 29 10:00:51.074450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 196/365] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:50 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:51.212775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-fe99efcd-5f36-45ff-a1cd-573eb1fdc7ce req-5e5a8dcd-3016-4ee1-afd1-8715544973cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bac0f78-62e4-4cd7-a3c4-5db0831d274b", "name": "network-vif-plugged", "status": "completed", "tag": "1927ed3c-4a6c-4cd4-980d-0f750cc50d93"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:51.224577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-fe99efcd-5f36-45ff-a1cd-573eb1fdc7ce req-5e5a8dcd-3016-4ee1-afd1-8715544973cb service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:51.225146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-fe99efcd-5f36-45ff-a1cd-573eb1fdc7ce req-5e5a8dcd-3016-4ee1-afd1-8715544973cb service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:51.245458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-fe99efcd-5f36-45ff-a1cd-573eb1fdc7ce req-5e5a8dcd-3016-4ee1-afd1-8715544973cb service nova] Creating event network-vif-plugged:1927ed3c-4a6c-4cd4-980d-0f750cc50d93 for instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b on hv-cinder-76810 Jun 29 10:00:51.253105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-fe99efcd-5f36-45ff-a1cd-573eb1fdc7ce req-5e5a8dcd-3016-4ee1-afd1-8715544973cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044618 Jun 29 10:00:51.254910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 197/366] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:00:51.369355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:51.381840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:51.385781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:51.390972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a6a7ce3f-5b09-4f29-a7b7-63fb256a8135 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.470331 Jun 29 10:00:51.394540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 170/367] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:51.680367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:51.681852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:51.689085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:51.689908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:51.699217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:51.699963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:51.926724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:51.928157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:51.951413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:51.956051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:51.979987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:51.983242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:52.136966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:52.145636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-01b0c759-17c1-42e1-8a47-e95ea870bbe9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1299 microversion: 2.1 time: 0.224834 Jun 29 10:00:52.159265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 171/368] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:51 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:52.168404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:52.170786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:52.191998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:52.192830 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:52.196035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:52.199198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:52.291373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:52.307747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f05c195a-7bac-417f-ba60-36fe25c15a5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1509 microversion: 2.1 time: 0.625528 Jun 29 10:00:52.308402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 198/369] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:51 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1509 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:52.420589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:52.425268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:52.446898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:52.447811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:52.449218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:52.450172 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:52.870109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:52.888256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-604bf449-014e-4aba-af26-6f8140e5e416 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1266 microversion: 2.1 time: 0.721511 Jun 29 10:00:52.897659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 172/370] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:52 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1266 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:53.118042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:53.131875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:53.139009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:53.141333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3bd9be60-148a-4939-b939-5c0ea9f675c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.734798 Jun 29 10:00:53.142679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 199/371] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:53.166127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:53.167603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:53.186751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:53.189657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:53.190640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:53.197156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:53.326635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:53.327253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:53.346351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:53.347088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:53.350950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:53.352455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:53.758229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:53.771365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-82035554-5d9f-41cc-a3cc-818f87349a86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1509 microversion: 2.1 time: 0.449266 Jun 29 10:00:53.772144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 200/372] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:53 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:53.914947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:53.915921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:53.927078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:53.930946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:53.932396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:53.936207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:54.299450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:54.317635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8328247e-41da-417b-a86f-810001b3e295 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 1.155854 Jun 29 10:00:54.321844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 173/373] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:53 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:54.335264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:54.345526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:54.366109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:54.366814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:54.367882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:54.371153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:54.535001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:54.556149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fcf6b6eb-fccd-4870-9226-405c6f844a13 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1454 microversion: 2.1 time: 0.635686 Jun 29 10:00:54.559471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 201/374] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:53 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1454 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:54.576190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:54.577095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:54.596209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:54.596448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:54.603487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:54.607184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:55.406990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:55.423853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b4f3a702-506f-4cc7-a6be-a8ba4f33d66c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1454 microversion: 2.1 time: 0.850494 Jun 29 10:00:55.424947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 202/375] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:54 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1454 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:00:55.451018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:55.452882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:55.472867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:55.474360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:55.479066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:55.489409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:55.490117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:55.492598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:55.504055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:55.508980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97d28f1c-1a28-42ca-8f98-08da884bbc53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 1.185073 Jun 29 10:00:55.511934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 174/376] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:55.521255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:55.521877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:55.571460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:55.572067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:55.573120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:55.573563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:56.351124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:56.363319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a242f35-a6fc-480d-bd2a-79e408201b96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1515 microversion: 2.1 time: 0.936220 Jun 29 10:00:56.365347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 203/377] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:55 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1515 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:56.478104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:56.518742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:56.532276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:56.534323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:56.547772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:56.549860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:56.553618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:56.557418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:56.786959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:57.170044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:57.183026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3f983a44-2ad5-49dc-95f4-7c663fa51cae tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 1.661462 Jun 29 10:00:57.186626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 175/378] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:55 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:57.691165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:57.714281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:57.721469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:57.724374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-febc9130-87de-4b8e-bc83-62aba7ca8a04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 1.198183 Jun 29 10:00:57.728903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 204/379] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:00:57.859401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-1565b63f-e9ea-44b9-b29e-a82427be1265 req-a335316b-ceb2-48b0-aa9a-c36da14e4bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891fa3e1-cc41-4a26-955e-f0f39c734140", "tag": "2b5523f6-bdee-4288-a37a-576256b2182d"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:00:57.872921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-1565b63f-e9ea-44b9-b29e-a82427be1265 req-a335316b-ceb2-48b0-aa9a-c36da14e4bcc service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:57.873363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-1565b63f-e9ea-44b9-b29e-a82427be1265 req-a335316b-ceb2-48b0-aa9a-c36da14e4bcc service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:57.898670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-1565b63f-e9ea-44b9-b29e-a82427be1265 req-a335316b-ceb2-48b0-aa9a-c36da14e4bcc service nova] Creating event network-changed:2b5523f6-bdee-4288-a37a-576256b2182d for instance 891fa3e1-cc41-4a26-955e-f0f39c734140 on hv-cinder-76810 Jun 29 10:00:57.913500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-1565b63f-e9ea-44b9-b29e-a82427be1265 req-a335316b-ceb2-48b0-aa9a-c36da14e4bcc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057633 Jun 29 10:00:57.917432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 176/380] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:00:58.204528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:58.205227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:58.214595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:58.218261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:58.224661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:58.228832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:58.584766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:58.597896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-35844c3b-1939-497a-a82d-0734d3dcc150 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 0.397579 Jun 29 10:00:58.598489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 205/381] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:58 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:00:58.745740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:58.746449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:58.762355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:58.762985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:58.763854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:58.764303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:59.136130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:59.156625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:00:59.175223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:59.185448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:00:59.191209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5d7d00a-283e-43b2-a6bf-a983760da12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.449886 Jun 29 10:00:59.197973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 177/382] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:00:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:00:59.616617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:00:59.618245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:00:59.654358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:59.657340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:00:59.663427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:00:59.665697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:00.214115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:00.214763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:00.228312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:00.229710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:00.233102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:00.233888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:00.469856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:00.500445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-52a12743-e317-4911-9c91-f79a29b126c2 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 0.886962 Jun 29 10:01:00.501723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 206/383] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:00:59 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:00.640647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-95306ced-49ec-4956-bbca-1cb312db99c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'create', calling method: .version_select at 0x7f387059ff70>, body: {"keypair": {"name": "tempest-keypair-1504965782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM3PRSNbAn22uAJi8DipicM1IBq8LrVO1/CxscCf0vQlMy1otZXS+B0PkEDNjxtc9DL7vPBIu7LA4L3+7yYo3z4i0O15kx+xwTR3zY1S6YVLNmV/cDfkAVf6M2+hqvnbg=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:00.672632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-95306ced-49ec-4956-bbca-1cb312db99c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for project c695a228acc84e93baf309bec5e489c4. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:01:00.680159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-95306ced-49ec-4956-bbca-1cb312db99c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for user 63ba0760d13e4bbda0650de803ef46ea and project c695a228acc84e93baf309bec5e489c4. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:01:00.723771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-95306ced-49ec-4956-bbca-1cb312db99c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090230 Jun 29 10:01:00.735932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 207/384] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:01:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:00.828740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:00.854745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:00.860300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:00.861559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f299640-8342-4153-92b8-6e9d94f59dde tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.652903 Jun 29 10:01:00.877633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 178/385] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:01.525043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:01.526309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:01.546246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:01.547493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:01.549740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:01.550583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:01.623204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-772080f3-3677-49a9-8bd8-1a0ac25f9801 req-0aa72698-e2d4-4c8d-a9fe-08bea53c1909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bac0f78-62e4-4cd7-a3c4-5db0831d274b", "tag": "1927ed3c-4a6c-4cd4-980d-0f750cc50d93"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:01.635433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-772080f3-3677-49a9-8bd8-1a0ac25f9801 req-0aa72698-e2d4-4c8d-a9fe-08bea53c1909 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:01.637775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-772080f3-3677-49a9-8bd8-1a0ac25f9801 req-0aa72698-e2d4-4c8d-a9fe-08bea53c1909 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:01.673628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-772080f3-3677-49a9-8bd8-1a0ac25f9801 req-0aa72698-e2d4-4c8d-a9fe-08bea53c1909 service nova] Creating event network-changed:1927ed3c-4a6c-4cd4-980d-0f750cc50d93 for instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b on hv-cinder-76810 Jun 29 10:01:01.689135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-772080f3-3677-49a9-8bd8-1a0ac25f9801 req-0aa72698-e2d4-4c8d-a9fe-08bea53c1909 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070327 Jun 29 10:01:01.706646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 179/386] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:01.880977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:01.881710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:01.895187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:01.895652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:01.896455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:01.896900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:02.149491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:02.160428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1573e282-5ba0-4d2a-9d1e-4b0391e0a3e9 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 0.645640 Jun 29 10:01:02.162004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 208/387] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:01 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:02.376302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:02.393964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:02.399094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:02.404535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a98fa7a-3994-47d5-81be-b3ef76ae7de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.527478 Jun 29 10:01:02.405402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 180/388] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:03.177657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:03.178274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:03.193068 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:03.193521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:03.194306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:03.194852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:03.424213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:03.425466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:03.438783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:03.439352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:03.445924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:03.448176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:03.777949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:03.788385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:03.794637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:03.796648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e7113283-68ff-457b-9f99-fcff836fe6d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.377100 Jun 29 10:01:03.802499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 181/389] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:04.817420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:04.818177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:04.838581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:04.853806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:04.857341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:04.865196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:05.203797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:05.215326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:05.223191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:05.228637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2966e74-7292-4435-8447-2d2c10c989d1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.415504 Jun 29 10:01:05.233474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 182/390] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:05.448737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:05.458515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e69cb18c-958d-4112-bb65-ca1be4708532 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 2.284944 Jun 29 10:01:05.462323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 209/391] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:03 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:06.249260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:06.250120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:06.261914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:06.262342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:06.264693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:06.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:06.479562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:06.480434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:06.507983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:06.508454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:06.509265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:06.509705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:07.048054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:07.074176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:07.079708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:07.083378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d71e44a7-63b7-478a-9538-21b5d5a50c85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.836417 Jun 29 10:01:07.086149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 183/392] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:07.545457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:07.571727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca6f952d-5f7a-45ac-85d5-4f46441997e3 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 1.079957 Jun 29 10:01:07.575833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 210/393] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:06 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:07.927070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1529536480", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3cd4382-18e9-435d-813a-72491e1c14a5"}], "security_groups": [{"name": "tempest-securitygroup--1945547989"}], "key_name": "tempest-keypair-1504965782", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:08.105906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:08.107075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:08.128414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:08.128862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:08.129669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:08.130100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:08.403974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:08.416508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:08.418019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:08.419277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f8b86882-e364-4889-9c8e-0dc57f9f977d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.318053 Jun 29 10:01:08.419833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 211/394] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:08.593427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:08.594170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:08.619571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:08.620027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:08.620840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:08.621279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:09.058279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:09.089127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3be0145d-07ad-47ba-9594-435ce96a6f0c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 0.496054 Jun 29 10:01:09.090715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 212/395] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:08 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:09.440349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:09.440987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:09.465219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:09.470300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:09.471329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:09.471796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:09.769309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:09.780881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:09.786072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:09.792219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-be933ad5-1cf2-497c-abe4-30bc2e5b4b7e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.356776 Jun 29 10:01:09.794652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 213/396] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:09.808103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-8412438d-160f-4e6e-a103-d1ea15dd5a66 req-e700ad09-094b-42e2-acd1-a686bb5cfbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891fa3e1-cc41-4a26-955e-f0f39c734140", "name": "network-vif-plugged", "status": "completed", "tag": "2b5523f6-bdee-4288-a37a-576256b2182d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:09.833339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-8412438d-160f-4e6e-a103-d1ea15dd5a66 req-e700ad09-094b-42e2-acd1-a686bb5cfbeb service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:09.833810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-8412438d-160f-4e6e-a103-d1ea15dd5a66 req-e700ad09-094b-42e2-acd1-a686bb5cfbeb service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:09.878720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-8412438d-160f-4e6e-a103-d1ea15dd5a66 req-e700ad09-094b-42e2-acd1-a686bb5cfbeb service nova] Creating event network-vif-plugged:2b5523f6-bdee-4288-a37a-576256b2182d for instance 891fa3e1-cc41-4a26-955e-f0f39c734140 on hv-cinder-76810 Jun 29 10:01:09.890010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-8412438d-160f-4e6e-a103-d1ea15dd5a66 req-e700ad09-094b-42e2-acd1-a686bb5cfbeb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088732 Jun 29 10:01:09.892545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 214/397] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:10.145651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:10.151662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:10.179697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:10.180307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:10.181150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:10.186517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:10.254105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:10.469798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:10.485738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-47975b9a-56b4-4c78-b12f-faeb0ab1e6bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 0.381377 Jun 29 10:01:10.496623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 215/398] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:10 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:10.819502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:10.821290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:10.824052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:10.831375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:10.832228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:10.833733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:10.834486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:11.025643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:11.035917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:11.039648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:11.041477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e2e0c4b-4d56-480d-99a4-06bf556faa9c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1740 microversion: 2.20 time: 0.226145 Jun 29 10:01:11.054136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 216/399] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:11.380151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] validate_networks() for [('e3cd4382-18e9-435d-813a-72491e1c14a5', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:01:11.505600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:11.506689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:11.524931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:11.528762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:11.530126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:11.531368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:11.688675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:11.794669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:11.803450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e488f50c-40da-40ae-bdf1-508b6afaab57 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1366 microversion: 2.1 time: 0.303738 Jun 29 10:01:11.814206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 217/400] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:11 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:11.988939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:01:11.989397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:01:11.989942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:01:11.990353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:01:11.990798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:01:12.003034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:12.003808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:12.004940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:12.005388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:12.025092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for project c695a228acc84e93baf309bec5e489c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:01:12.029551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Getting quotas for user 63ba0760d13e4bbda0650de803ef46ea and project c695a228acc84e93baf309bec5e489c4. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:01:12.041772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:01:12.044375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:01:12.063891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:12.064718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:12.075413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:12.076028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:12.077110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:12.077533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:12.111751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-95292dca-343a-4e1e-b68c-ba340fae11b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.198704 Jun 29 10:01:12.113484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 184/401] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:01:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 4201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:01:12.126387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-378c70ae-91dd-4464-8ddb-9170509e7436 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:12.127369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-378c70ae-91dd-4464-8ddb-9170509e7436 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:12.249838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-378c70ae-91dd-4464-8ddb-9170509e7436 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:12.258653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-378c70ae-91dd-4464-8ddb-9170509e7436 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1246 microversion: 2.1 time: 0.135521 Jun 29 10:01:12.259360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 185/402] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:12.326081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:12.336356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:12.338175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:12.339422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-084a14e1-1fe7-42f1-9f97-407c416b18ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.282559 Jun 29 10:01:12.342885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 218/403] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:12.833369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:12.834374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:12.841714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:12.842276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:12.843727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:12.843727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:12.991673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:13.000156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b345c644-a35a-42c5-b283-bb0422c1f2e7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1556 microversion: 2.1 time: 0.170578 Jun 29 10:01:13.001171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 186/404] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:12 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:13.017500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:13.018254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:13.027168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:13.027994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:13.029032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:13.029506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:13.124288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c1a883c-bedc-4a23-9267-a835f0dbfe91 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110682 Jun 29 10:01:13.125576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 219/405] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:01:13 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:13.276669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:13.277647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:13.286596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:13.289389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:13.290718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:13.291397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:13.357443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:13.358355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:13.365022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:13.365727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:13.367030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:13.367719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:13.387502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:13.396963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b19f3e1f-cef1-451b-af76-b4982cb2c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1250 microversion: 2.1 time: 0.124376 Jun 29 10:01:13.398017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 187/406] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1250 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:13.643096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:13.662148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:13.665237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:13.669504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-47535065-7ab3-49c2-ae5f-f3f94d701b3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.315981 Jun 29 10:01:13.673060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 220/407] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:14.281484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-93fa1365-56cf-45ca-897e-eaab552dd9fb req-156d25e5-3ace-4ae4-bdd2-8f45373e4dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891fa3e1-cc41-4a26-955e-f0f39c734140", "tag": "2b5523f6-bdee-4288-a37a-576256b2182d"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:14.293798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-93fa1365-56cf-45ca-897e-eaab552dd9fb req-156d25e5-3ace-4ae4-bdd2-8f45373e4dad service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:14.294274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-93fa1365-56cf-45ca-897e-eaab552dd9fb req-156d25e5-3ace-4ae4-bdd2-8f45373e4dad service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:14.308300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-93fa1365-56cf-45ca-897e-eaab552dd9fb req-156d25e5-3ace-4ae4-bdd2-8f45373e4dad service nova] Creating event network-changed:2b5523f6-bdee-4288-a37a-576256b2182d for instance 891fa3e1-cc41-4a26-955e-f0f39c734140 on hv-cinder-76810 Jun 29 10:01:14.313961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-93fa1365-56cf-45ca-897e-eaab552dd9fb req-156d25e5-3ace-4ae4-bdd2-8f45373e4dad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036065 Jun 29 10:01:14.317647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 188/408] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:14.415476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:14.416773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:14.423570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:14.424271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:14.425220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:14.425802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:14.506612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:14.515305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a05e32fc-bf95-4c3d-b61b-395487f8a91d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1250 microversion: 2.1 time: 0.103915 Jun 29 10:01:14.527127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 221/409] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1250 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:14.695580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:14.696299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:14.704936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:14.705536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:14.706626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:14.707207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:15.003185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:15.021109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:15.041808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:15.046656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5b823fa-74d3-47a7-a672-afd394412120 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.355319 Jun 29 10:01:15.055866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 189/410] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:15.534595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:15.540195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:15.549886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:15.554758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:15.556197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:15.559281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:15.560770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:15.667326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:15.675966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4eab90eb-ceb5-485f-8bac-e3f9eec91b21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1298 microversion: 2.1 time: 0.146952 Jun 29 10:01:15.677145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 222/411] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:16.005406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-455c184b-3d47-4430-b3f4-c8764529410a req-27ab438d-8841-4b44-af38-25be5bd96ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "name": "network-vif-unplugged", "status": "completed", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:16.036805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-455c184b-3d47-4430-b3f4-c8764529410a req-27ab438d-8841-4b44-af38-25be5bd96ca9 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:16.037257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-455c184b-3d47-4430-b3f4-c8764529410a req-27ab438d-8841-4b44-af38-25be5bd96ca9 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:16.066125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-455c184b-3d47-4430-b3f4-c8764529410a req-27ab438d-8841-4b44-af38-25be5bd96ca9 service nova] Creating event network-vif-unplugged:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 10:01:16.068540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:16.069673 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:16.079267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:16.085337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-455c184b-3d47-4430-b3f4-c8764529410a req-27ab438d-8841-4b44-af38-25be5bd96ca9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083884 Jun 29 10:01:16.086301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 190/412] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:16.098784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:16.102129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:16.103889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:16.686864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:16.700091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:16.700091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:16.700414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:16.700414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:16.700414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6ff4a169-7692-4cd2-8acd-0a02e5680eb8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.636914 Jun 29 10:01:16.700680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 223/413] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:16.702192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:16.702678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:16.703470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:16.703905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:16.777017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:16.784774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e2830b4-e174-402a-a8db-870d789bd3f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1304 microversion: 2.1 time: 0.095133 Jun 29 10:01:16.785357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 191/414] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:16.867589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ba5861dd-0279-420d-a652-d609f17fef9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Action: 'create', calling method: .version_select at 0x7f38703715e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-260809395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo3Cnh7Oq5gqCV0mzOgxIOUWCIUGsmM3jqkwMQbsBK1KOvWG2Rrf2CCxVqUMmdGGmNnWSRH0SHSZJvAFuLlu9q5MoRWayWuW6Xiaro4Aj7q3mFQ4zbGaB9FFPmnysxqdg=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:16.881723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-ba5861dd-0279-420d-a652-d609f17fef9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Getting quotas for project ce73b243663d4ee6b991c9262d1286d5. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:01:16.886175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-ba5861dd-0279-420d-a652-d609f17fef9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Getting quotas for user f2ed196e5ad6415aa9b7a7c1b3dad277 and project ce73b243663d4ee6b991c9262d1286d5. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:01:16.912053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ba5861dd-0279-420d-a652-d609f17fef9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048336 Jun 29 10:01:16.912670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 224/415] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:01:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:17.083554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-37191015", "imageRef": "19f3caf9-0212-4cda-8344-b025ae858715", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-260809395", "networks": [{"uuid": "ae49209c-93ad-4b45-a7a4-ddcc6c778ef5"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:17.136132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] validate_networks() for [('ae49209c-93ad-4b45-a7a4-ddcc6c778ef5', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:01:17.718657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:17.719268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:17.726346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:17.726856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:17.727626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:17.728059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:17.763183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:01:17.763608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:01:17.764076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:01:17.764484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:01:17.764892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:01:17.775867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:17.776536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:17.777512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:17.777957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:17.797148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Getting quotas for project ce73b243663d4ee6b991c9262d1286d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:01:17.802182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Getting quotas for user f2ed196e5ad6415aa9b7a7c1b3dad277 and project ce73b243663d4ee6b991c9262d1286d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:01:17.821915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:01:17.824323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19f3caf9-0212-4cda-8344-b025ae858715',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:01:17.871091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:17.872714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-027e967e-4d80-4019-95e0-5b3da0a95deb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795459 Jun 29 10:01:17.873625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 192/416] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:01:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:01:17.878317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:17.878770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:17.885497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:17.885763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:17.886001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:17.886808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:17.887234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:17.887535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:17.888921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-92e24853-e1a8-4671-bf89-f030ba388461 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.174970 Jun 29 10:01:17.889455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 225/417] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:17.894052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e56e1361-faa0-4680-bc37-7ba51e511458 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:17.894900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e56e1361-faa0-4680-bc37-7ba51e511458 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:17.950662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e56e1361-faa0-4680-bc37-7ba51e511458 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:17.954280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:17.959949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e56e1361-faa0-4680-bc37-7ba51e511458 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1256 microversion: 2.1 time: 0.069282 Jun 29 10:01:17.961045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 226/418] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1256 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:17.963438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a15015e1-c29a-4c81-95d8-1b9db0ec25ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1304 microversion: 2.1 time: 0.089078 Jun 29 10:01:17.964261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 193/419] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:18.908663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:18.909544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:18.918052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:18.918803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:18.920620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:18.921350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:18.978706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:18.979976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:18.990682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:18.991463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:18.993092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:18.993940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:19.083899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:19.096913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4b278e0d-5ece-4ce7-a5cd-327767d6affc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1252 microversion: 2.1 time: 0.122397 Jun 29 10:01:19.099168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 194/420] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1252 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:19.106642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:19.107685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:19.115544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:19.116220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:19.118771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:19.119532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:19.186245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:19.196635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:19.198416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:19.199859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94c9f29b-0568-439d-bb4c-8ddd3626b9cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.295213 Jun 29 10:01:19.200756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 227/421] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:19.242887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:19.250904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd2dd62d-eb20-42f5-80f1-621df66deac8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1304 microversion: 2.1 time: 0.150298 Jun 29 10:01:19.251534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 195/422] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:20.118139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:20.118812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:20.128646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:20.129272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:20.130375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:20.130995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:20.202147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:20.213842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f5a2e037-85e6-4099-a99e-26b2f999a759 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1308 microversion: 2.1 time: 0.100517 Jun 29 10:01:20.215555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 228/423] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:20 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:20.220942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:20.222250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:20.244939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:20.245534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:20.246471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:20.247238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:20.272300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:20.272300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:20.279358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:20.280010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:20.280901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:20.281469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:20.431797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:20.442644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:20.444831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:20.449609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:20.453489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4706b9a0-ed2f-4cdf-813f-634265c20239 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1722 microversion: 2.20 time: 0.231110 Jun 29 10:01:20.455419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 196/424] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:20.457946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-389ae8cb-d386-48db-9915-8cf6de371151 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.190145 Jun 29 10:01:20.458694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 229/425] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:21.232050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:21.232914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:21.246411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.246939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.247900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.248117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.322199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:21.331289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd6799e1-a107-48cd-9ff0-9fe225509a9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1314 microversion: 2.1 time: 0.103113 Jun 29 10:01:21.331847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 197/426] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1314 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:21.410849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-758a9f10-4378-472e-827b-b8ea8d1c9590 req-b5e22da3-e82a-4e20-ae87-98d09588a4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:21.422000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-758a9f10-4378-472e-827b-b8ea8d1c9590 req-b5e22da3-e82a-4e20-ae87-98d09588a4b7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.422594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-758a9f10-4378-472e-827b-b8ea8d1c9590 req-b5e22da3-e82a-4e20-ae87-98d09588a4b7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.444312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-758a9f10-4378-472e-827b-b8ea8d1c9590 req-b5e22da3-e82a-4e20-ae87-98d09588a4b7 service nova] Creating event network-changed:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:01:21.450460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-758a9f10-4378-472e-827b-b8ea8d1c9590 req-b5e22da3-e82a-4e20-ae87-98d09588a4b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044920 Jun 29 10:01:21.451331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 230/427] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:21.477973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:21.478733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:21.484402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:21.485475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:21.486663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.487188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.488048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.488539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.492977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.493642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.494689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.495380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.883430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:21.887734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:21.900902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:21.902446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:21.906601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c32a8eeb-6823-4165-bdda-bbe224b4243d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1725 microversion: 2.20 time: 0.436617 Jun 29 10:01:21.926781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 198/428] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1725 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:21.936333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:21.941066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f609a05-88ca-4ef0-b99a-91a72edddae2"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:21.943003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:21.946652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9ce92ec5-2c00-4660-9114-0585941b1cce tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.473268 Jun 29 10:01:21.949541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 231/429] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:21.970945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.973216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:21.981649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:21.982460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:22.355095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:22.357326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:22.389236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:22.389674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:22.390458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:22.391387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:22.513578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:22.526954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-869987d5-b8a1-44eb-a375-983a6b98d165 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1314 microversion: 2.1 time: 0.181071 Jun 29 10:01:22.537879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 232/430] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:22 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:22.612361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a09168fb-71da-4367-8bf2-a64cf5e897e8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.683553 Jun 29 10:01:22.614029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 199/431] 10.222.0.52 () {62 vars in 1363 bytes} [Wed Jun 29 10:01:21 2022] POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 188 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:01:22.817442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:22.818018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:22.825182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:22.825908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:22.826911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:22.827499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:22.974813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:22.976727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:22.993496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:22.994224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:22.996247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:22.996877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:23.002699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-feaddaca-7709-405d-922c-ae5ac3850a65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/action" status: 202 len: 0 microversion: 2.20 time: 0.188056 Jun 29 10:01:23.008505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 233/432] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 10:01:22 2022] POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:01:23.020277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:23.029142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:23.050731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:23.053847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:23.055522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:23.058185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:23.077843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:23.251635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:23.269038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74bbb77c-d215-472d-afc6-004e2a364ce8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.305713 Jun 29 10:01:23.271262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 200/433] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:23.390332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:23.401524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:23.404054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:23.409419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-42f4df10-ca83-4600-895c-5cc76d3b86c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.395913 Jun 29 10:01:23.410670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 234/434] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:23.544770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:23.545558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:23.553926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:23.554843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:23.555882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:23.556557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:23.751876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:23.760306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76ab8a9d-0255-4c3c-8c53-c9ef68af064f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.219548 Jun 29 10:01:23.770659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 201/435] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:24.287452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:24.289823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:24.300778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:24.301121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:24.301888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:24.302319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:24.430083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:24.430965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:24.441878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:24.443924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:24.446313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:24.446789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:24.552894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:24.562352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-301975f6-c295-42b7-8349-1ae7245b46c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.279084 Jun 29 10:01:24.563180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 235/436] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:24.622874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:24.633148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:24.635251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:24.636382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ffe5be53-f0c9-4ebc-ab3b-d10e5f9fdf8e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.210864 Jun 29 10:01:24.637307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 202/437] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:24.780072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:24.780687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:24.793185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:24.793640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:24.794392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:24.794851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:24.998731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:25.019517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-90616a7f-8c1f-46a5-a0dc-403ddaaa0116 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.243092 Jun 29 10:01:25.020185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 236/438] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:25.579844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:25.580476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:25.587206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:25.587655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:25.588500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:25.588936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:25.654902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:25.656165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:25.669752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:25.670216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:25.671044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:25.671686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:25.769208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:25.778392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f92f12c4-7c02-4312-9cd0-668cf079d3a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.202350 Jun 29 10:01:25.779188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 203/439] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:25.838370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:25.850164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:25.852968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:25.854863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9b37cfcf-a6f0-4557-9fbd-501221430018 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.203952 Jun 29 10:01:25.856014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 237/440] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:26.037391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:26.038050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:26.045127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:26.045588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:26.046402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:26.046882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:26.190478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:26.198890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-313f55db-bcdd-49ad-ad39-d7025daf2bd6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.165390 Jun 29 10:01:26.199472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 204/441] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:26 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:26.796491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:26.797249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:26.816293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:26.817820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:26.820166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:26.820970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:26.873572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:26.874197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:26.880611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:26.881056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:26.881854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:26.882298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:26.998533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:27.006489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f2ed44a0-9cac-4858-bc6a-33f4ac02a8a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.214622 Jun 29 10:01:27.007193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 238/442] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:27.057450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:27.066674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:27.068344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:27.069676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27085e45-9549-42dd-86ee-27a4cb7db8f6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.200103 Jun 29 10:01:27.070843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 205/443] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:27.216452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:27.217060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:27.223882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:27.224210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:27.224989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:27.225434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:27.384962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:27.392541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3d147bd9-87d7-4064-ac7f-6cc3de66185d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.179987 Jun 29 10:01:27.393113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 239/444] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:28.024251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:28.024795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:28.027115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:28.027898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=14 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:28.034550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:28.035057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:28.036015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:28.036452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:28.092623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:28.093314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:28.105963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:28.108286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:28.108837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:28.109884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:28.110527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:28.231109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:28.240528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48298092-3697-4c23-b04d-a806f86160c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.220548 Jun 29 10:01:28.250230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 206/445] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:28.309521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:28.321162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:28.323922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:28.325420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-96c9d80f-425d-47db-a5f5-41861e148486 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.238809 Jun 29 10:01:28.326741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 240/446] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:28.409920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:28.410741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:28.418017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:28.418817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:28.420418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:28.421248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:28.584198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:28.593514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5881961a-4482-4a69-9b19-1bfb223258a2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.187752 Jun 29 10:01:28.594354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 207/447] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:29.258941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:29.259613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:29.267387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:29.268170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:29.269001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:29.269437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:29.346023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:29.347474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:29.354992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:29.355457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:29.356269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:29.356671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:29.448526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:29.456802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3002af62-9290-4049-bb4d-33402a537dc4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.202686 Jun 29 10:01:29.457396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 241/448] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:29.531533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:29.540953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:29.542461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:29.543690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc4e461a-0ba2-4e7a-b3bc-d9187ecfd975 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.202443 Jun 29 10:01:29.544250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 208/449] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:29.610814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:29.611720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:29.619710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:29.620441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:29.621378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:29.621953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:29.767362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:29.775326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d3e73112-9c03-4e4a-b853-297eeadd1dac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.168296 Jun 29 10:01:29.785410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 242/450] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:29 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:30.475642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:30.476946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:30.484336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:30.485327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:30.486295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:30.486926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:30.562553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:30.563338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:30.570522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:30.571010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:30.572940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:30.573391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:30.673760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:30.693472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4de22ebe-1bd0-4f99-bc23-770b1017aff3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.222064 Jun 29 10:01:30.696762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 209/451] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:30.766282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:30.777919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:30.779438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:30.780842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3180e428-5b5a-4f33-af19-14970148c60a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.222451 Jun 29 10:01:30.781600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 243/452] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:30.793366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:30.793544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:30.800755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:30.801212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:30.801992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:30.802440 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:30.953158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:30.964258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-008e02e0-2967-40fd-aa87-3d8b26e2cb27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.175310 Jun 29 10:01:30.965863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 210/453] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:31.712143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:31.712818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:31.719650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:31.720093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:31.720857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:31.721289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:31.801300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:31.802006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:31.808691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:31.809136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:31.809921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:31.810335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:31.872120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:31.880061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9292020-c7f3-4d77-91f1-4084160a5724 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.172294 Jun 29 10:01:31.880652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 244/454] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:31.958001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:31.967654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:31.969135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:31.970318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0562d17-37dd-4324-a6d8-88705e694b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1751 microversion: 2.20 time: 0.172969 Jun 29 10:01:31.970905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 211/455] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:31.985600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:31.986229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:31.993224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:31.993699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:31.994488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:31.994958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:32.208073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:32.219302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7aaea7f3-ef03-4607-99c3-be71cc02ae01 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.241054 Jun 29 10:01:32.230772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 245/456] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:32.904965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:32.907209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:32.922080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:32.923278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:32.924960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:32.925962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:32.994118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:32.994969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:33.008661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:33.011223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:33.012670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:33.013454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:33.191549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:33.195685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:33.208737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-776c38bc-3128-4b1a-9814-e2aa2a5db2e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.310558 Jun 29 10:01:33.211377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 212/457] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:33.240235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:33.241196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:33.249249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:33.249706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:33.250520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:33.251218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:33.275211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:33.287378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:33.289715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:33.291352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f30939b-88a4-4533-b6a3-94cd1f8dc826 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1753 microversion: 2.20 time: 0.301779 Jun 29 10:01:33.292669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 246/458] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1753 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:33.348600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-3850d9b6-fa08-4667-a8ce-cd8b0295703b req-7fdf5261-8173-413b-8f59-dbf28d320024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:33.363213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-3850d9b6-fa08-4667-a8ce-cd8b0295703b req-7fdf5261-8173-413b-8f59-dbf28d320024 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:33.364009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-3850d9b6-fa08-4667-a8ce-cd8b0295703b req-7fdf5261-8173-413b-8f59-dbf28d320024 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:33.377693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-3850d9b6-fa08-4667-a8ce-cd8b0295703b req-7fdf5261-8173-413b-8f59-dbf28d320024 service nova] Creating event network-changed:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:01:33.385809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-3850d9b6-fa08-4667-a8ce-cd8b0295703b req-7fdf5261-8173-413b-8f59-dbf28d320024 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040742 Jun 29 10:01:33.391129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 247/459] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:33.449666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:33.460520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-36e39122-410e-4e7a-90c9-5b37ae0892ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.223311 Jun 29 10:01:33.462070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 213/460] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:33 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:34.236127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:34.238113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:34.249420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:34.250504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:34.252014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:34.252755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:34.317156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:34.318781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:34.327289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:34.328137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:34.329111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:34.329665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:34.516657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:34.532794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:34.534778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:34.536398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26647f10-b9b0-4515-8346-c6e8392750c8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1753 microversion: 2.20 time: 0.230257 Jun 29 10:01:34.537539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 214/461] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1753 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:01:34.543656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:34.544575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:34.552052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:34.552504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:34.553682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:34.554137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:34.590986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:34.605484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-81a2affb-5743-45bb-9695-e5520b054648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.380717 Jun 29 10:01:34.612066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 248/462] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:34.734486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:34.742385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8af3e662-7e49-472a-b3e2-b63f72e0a032 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.203119 Jun 29 10:01:34.743192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 215/463] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:35.557213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:35.557837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:35.564861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:35.565284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:35.566283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:35.566759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:35.632935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:35.633743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:35.644183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:35.644892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:35.645864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:35.646292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:35.810621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:35.822427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-55b0cb07-a8ba-45b7-abdb-761b5a3c8c64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.195396 Jun 29 10:01:35.827208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 216/464] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:35.835503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:35.836351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:35.844075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:35.844693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:35.845596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:35.846210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:35.991456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:36.002064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:36.005361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:36.007001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-343193f5-6e33-4752-ad26-685a70323077 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.453990 Jun 29 10:01:36.007926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 249/465] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:36.106595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:36.117789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb894611-3753-484a-8fdf-a956d8c6197e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.289039 Jun 29 10:01:36.118419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 217/466] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:35 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:36.840659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:36.841468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:36.849521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:36.850021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:36.851339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:36.851785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:37.000385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:37.009190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-170e7ca9-e7d9-4f9c-bd16-40ca779c7bb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.172362 Jun 29 10:01:37.009802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 250/467] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:37.031215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:37.031837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:37.033833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:37.040113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:37.040629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:37.041397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:37.041832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:37.138879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:37.139888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:37.148298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:37.148912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:37.150265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:37.151076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:37.184533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:37.205749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:37.216102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:37.217626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:37.218817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad51bcfd-080e-4f07-9167-acbe00c4c128 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.191648 Jun 29 10:01:37.219587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 218/468] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:37.370677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:37.378648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-21c0cfc6-1c4e-412f-9fb8-5fe353b2b270 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.246408 Jun 29 10:01:37.379494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 251/469] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:37.481301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-4b1c2fa7-dad4-4da1-8648-1702ffa46c97 req-b4cc4bc3-18fe-4f8c-991d-e0e6f8f47b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "name": "network-vif-plugged", "status": "completed", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:37.495515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4b1c2fa7-dad4-4da1-8648-1702ffa46c97 req-b4cc4bc3-18fe-4f8c-991d-e0e6f8f47b05 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:37.495953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-4b1c2fa7-dad4-4da1-8648-1702ffa46c97 req-b4cc4bc3-18fe-4f8c-991d-e0e6f8f47b05 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:37.509949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-4b1c2fa7-dad4-4da1-8648-1702ffa46c97 req-b4cc4bc3-18fe-4f8c-991d-e0e6f8f47b05 service nova] Creating event network-vif-plugged:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:01:37.515220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-4b1c2fa7-dad4-4da1-8648-1702ffa46c97 req-b4cc4bc3-18fe-4f8c-991d-e0e6f8f47b05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038754 Jun 29 10:01:37.515708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 219/470] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:38.035958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:38.035958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:38.049100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:38.050347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:38.056527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:38.057223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:38.214107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:38.225395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7a9264c-771a-424e-ab0d-2714290bd3c2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.200474 Jun 29 10:01:38.226128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 252/471] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:38.237962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:38.239860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:38.249172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:38.249702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:38.250595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:38.251136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:38.396047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:38.396944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:38.399477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:38.404618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:38.405243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:38.406211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:38.406684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:38.409433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:38.411012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:38.412226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03ff3d74-be89-4af8-90ff-e5e490f82bbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.178682 Jun 29 10:01:38.414837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 220/472] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:38.558334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:38.566326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5c7a9727-33d9-4bf3-9eab-be0b062c2287 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.174003 Jun 29 10:01:38.566871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 253/473] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:38 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:39.242946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:39.243729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:39.250384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:39.250855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:39.251627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:39.252053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:39.393233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:39.400900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b348c2a-cccb-4423-abc0-d15b90e2f478 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.162035 Jun 29 10:01:39.401508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 221/474] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:39.431851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:39.433355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:39.444058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:39.444730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:39.445750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:39.446190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:39.584202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:39.585786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:39.597268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:39.598387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:39.600428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:39.601445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:39.615044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:39.624656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:39.626227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:39.627741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7b177493-0845-41f2-9d4d-2f692f12613f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.200949 Jun 29 10:01:39.630429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 254/475] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:39.809185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:39.818495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10aa84f7-f6f2-4360-9a55-aaa041b8238c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.238452 Jun 29 10:01:39.819127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 222/476] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:40.418555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:40.419567 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:40.426248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:40.426694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:40.427506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:40.427931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:40.572577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:40.580415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e0a4214-39e7-42eb-aa23-7f24b5f2161b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.166020 Jun 29 10:01:40.580999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 255/477] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:40.646948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:40.647666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:40.654076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:40.654517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:40.655305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:40.655731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:40.821397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:40.834804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:40.836866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:40.838063 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69a17f67-a4cd-43eb-820c-794e86f69e4e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.195166 Jun 29 10:01:40.838666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 223/478] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:40.839663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:40.840953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:40.853685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:40.854594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:40.856011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:40.857090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:41.135397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:41.144606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3e0d3cb-f18b-48d2-b260-4774bdd68810 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.310920 Jun 29 10:01:41.156113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 256/479] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:41.598557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:41.599278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:41.610304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:41.611577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:41.613112 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:41.615330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:41.615820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-950bf231-0a5c-4b1b-8454-22a51a1b7b9b req-0fc3e7c1-5800-4dbd-b715-fe558cf1c961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "name": "network-vif-plugged", "status": "completed", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:41.627708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-950bf231-0a5c-4b1b-8454-22a51a1b7b9b req-0fc3e7c1-5800-4dbd-b715-fe558cf1c961 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:41.628487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-950bf231-0a5c-4b1b-8454-22a51a1b7b9b req-0fc3e7c1-5800-4dbd-b715-fe558cf1c961 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:41.643214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-950bf231-0a5c-4b1b-8454-22a51a1b7b9b req-0fc3e7c1-5800-4dbd-b715-fe558cf1c961 service nova] Creating event network-vif-plugged:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:01:41.650558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-950bf231-0a5c-4b1b-8454-22a51a1b7b9b req-0fc3e7c1-5800-4dbd-b715-fe558cf1c961 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039116 Jun 29 10:01:41.655571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 257/480] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:41.856063 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:41.867697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8b22a5e-4448-4b38-9a29-efe1cad562b3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.272923 Jun 29 10:01:41.870728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 224/481] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:41.871159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:41.872331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:41.889247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:41.890031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:41.890863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:41.891499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:42.039713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:42.050664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:42.052292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:42.053682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-58debbdb-504e-4ee1-8143-c525720a7bba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.187446 Jun 29 10:01:42.054450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 258/482] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:42.165262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:42.165819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:42.172206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:42.172657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:42.173425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:42.173875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:42.318235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:42.326432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2b4460f-d597-48cd-9ef2-efc644e67340 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.166061 Jun 29 10:01:42.327237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 225/483] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:42 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:42.886054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:42.886905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:42.893925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:42.894373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:42.895319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:42.895759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:43.075296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:43.076654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:43.089376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:43.089760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:43.090936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:43.091679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:43.093864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:43.104800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7370e569-f950-4d77-81d9-e51252d7eb2b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.222747 Jun 29 10:01:43.105569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 259/484] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:43.319181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:43.344069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:43.344864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:43.349447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:43.351767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:43.353662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5456acf3-169e-4c90-968a-52b5a02a8204 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.283945 Jun 29 10:01:43.358627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 226/485] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:43.368181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:43.368181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:43.368181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:43.368181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:43.548304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:43.557733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-34cb2fc2-e6e5-4b9c-91ac-05906a1b3cb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.217774 Jun 29 10:01:43.558309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 260/486] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:44.121447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:44.122409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:44.130961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:44.131989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:44.133524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:44.134756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:44.309679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:44.318132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4287e01-5575-4c62-ba47-4358d61aeb0b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.200448 Jun 29 10:01:44.318767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 227/487] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:44.372256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:44.372867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:44.381229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:44.382985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:44.384128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:44.384571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:44.563654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:44.574163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:44.575951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:44.575951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:44.578738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:44.580276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f4255c8a-d577-46bc-ac49-a3da4f9a340b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.211995 Jun 29 10:01:44.591723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 261/488] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:44.591980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:44.591980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:44.591980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:44.591980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:44.735951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:44.753974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca2e64dc-829f-4158-ac26-273aeafd2403 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.182394 Jun 29 10:01:44.754934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 228/489] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:44 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:45.338675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:45.339170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:45.345416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:45.345877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:45.346684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:45.347130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:45.512049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:45.520875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19e60d87-5601-4d85-974b-d1de8e6a7481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.186938 Jun 29 10:01:45.521489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 262/490] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:45.603186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:45.605244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:45.619339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:45.620034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:45.621327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:45.621607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:45.773663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:45.774205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:45.776296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:45.782941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:45.783730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:45.784661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:45.784859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:45.785488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:45.794479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:45.796071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:45.797495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79c384c9-7c44-460f-8473-582ef0a0a014 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.200066 Jun 29 10:01:45.798138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 229/491] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:45.939754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:45.947945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0e841c5b-f9a6-497e-b719-ab846386ec63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.179668 Jun 29 10:01:45.948526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 263/492] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:46.538938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:46.539714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:46.559254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:46.559741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:46.560684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:46.561117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:46.566320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:46.747717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:46.757768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b02c6da-1787-410b-ace1-5fee86fc8174 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.222751 Jun 29 10:01:46.758584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 230/493] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:46.818186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:46.818935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:46.827046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:46.827696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:46.828832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:46.829268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:46.966602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:46.967613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:46.977987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:46.978713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:46.980155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:46.981201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:47.082327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:47.110315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:47.113854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:47.115619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5323930d-0f87-4a22-8ab3-59397ea91a69 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.301519 Jun 29 10:01:47.116496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 264/494] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:47.166838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:47.175930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64747b83-e308-4ffa-8e6f-b0786988a4ec tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.213664 Jun 29 10:01:47.176962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 231/495] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:47.780317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:47.781489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:47.792873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:47.793676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:47.795032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:47.795813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:47.943300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:47.951591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-327f50e8-322a-4aff-af56-59e749700cc0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1372 microversion: 2.1 time: 0.179590 Jun 29 10:01:47.952162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 265/496] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:48.136869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:48.137719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:48.144681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:48.145137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:48.145928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:48.146369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:48.194440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:48.195224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:48.202157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:48.202643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:48.203448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:48.203876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:48.306593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:48.320057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:48.320057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:48.320057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6924c4e-eb15-4fca-a32a-3f78d4df789d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.186497 Jun 29 10:01:48.320377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 232/497] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:48.404898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:48.413411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-67d8d9f0-5670-4f51-a217-3d127ed8de36 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.223408 Jun 29 10:01:48.414029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 266/498] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:48.970503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:48.971757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:48.981428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:48.981428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:48.981428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:48.981831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.160062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:49.169345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ee061d1-3e86-4d6f-8b40-b63b043b6ce7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1565 microversion: 2.1 time: 0.203239 Jun 29 10:01:49.169906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 233/499] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:49.192227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:49.192915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:49.212198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:49.213086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.214275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:49.214805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.317878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8e5e4730-1263-4aba-8e77-26e2bb28509f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129543 Jun 29 10:01:49.318626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 267/500] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:01:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:49.339558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:49.340322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:49.348521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:49.349128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.350465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:49.350853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.430991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:49.431705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:49.438375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:49.438996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.439885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:49.440426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:49.629206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:49.639263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1706e6f6-9d38-4949-b119-8bea573faa81 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1356 microversion: 2.1 time: 0.212255 Jun 29 10:01:49.639935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 268/501] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:49 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1356 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:49.660164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:49.670158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:49.671679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:49.672852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-17e6bed2-36b3-4d4b-b09d-8fc1fbdf185a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.338362 Jun 29 10:01:49.673596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 234/502] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:50.354603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-bb188753-52ff-4d42-89ca-c855fb756a9a req-9e5e6ac9-842f-4a74-8d83-68d48e68aed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:50.363384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-bb188753-52ff-4d42-89ca-c855fb756a9a req-9e5e6ac9-842f-4a74-8d83-68d48e68aed3 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.363822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-bb188753-52ff-4d42-89ca-c855fb756a9a req-9e5e6ac9-842f-4a74-8d83-68d48e68aed3 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:50.368371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:01:50.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-bb188753-52ff-4d42-89ca-c855fb756a9a req-9e5e6ac9-842f-4a74-8d83-68d48e68aed3 service nova] Creating event network-changed:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:01:50.381890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-bb188753-52ff-4d42-89ca-c855fb756a9a req-9e5e6ac9-842f-4a74-8d83-68d48e68aed3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031525 Jun 29 10:01:50.382990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 269/503] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:50.666247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:50.666813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:50.673035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.673487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:50.674248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.674712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:50.693297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:50.694077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:50.704233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.704873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:50.705803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.706381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:50.818649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:50.828181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b38db124-7828-4543-9f57-0d72344738d9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1546 microversion: 2.1 time: 0.176001 Jun 29 10:01:50.831377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 235/504] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:50.833761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1186145183", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "networks": [{"uuid": "737b2711-5045-4982-80e4-c97cab2e2a44"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:50.864868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:50.874495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:50.878819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:50.880164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0cf1a884-49f9-44bf-8c22-9d2414c52326 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.191257 Jun 29 10:01:50.883648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 270/505] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:50.887392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:50.888224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:50.894804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] validate_networks() for [('737b2711-5045-4982-80e4-c97cab2e2a44', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:01:50.895951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.896481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:50.897500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:50.898476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.107841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:51.117581 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f8ff901c-76cb-4d74-a0e5-d9a56806764d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1546 microversion: 2.1 time: 0.234850 Jun 29 10:01:51.118510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 271/506] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:51.135275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:51.139379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:51.140184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Searching by: {'deleted': False, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5'} {{(pid=117950) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 29 10:01:51.149440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.149889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.150965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.151576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.260990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.multi_cell_list [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117950) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 29 10:01:51.328341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:01:51.328770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:01:51.329252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:01:51.329717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:01:51.330137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:01:51.340960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.341619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.343076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.343520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.377758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Getting quotas for project 4779579fbd6f42dcb6ad98e752ef741c. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:01:51.379804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d17fedd8-2c57-4975-be6e-4717f15a8fc4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.249520 Jun 29 10:01:51.382597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 272/507] 10.222.0.52 () {58 vars in 1124 bytes} [Wed Jun 29 10:01:51 2022] GET /compute/v2.1/servers => generated 341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:01:51.383036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Getting quotas for user 43964a0e6b48487bb90c5356d312b60d and project 4779579fbd6f42dcb6ad98e752ef741c. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:01:51.393259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:51.394852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:51.396344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:01:51.399933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:01:51.404683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.405513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.406489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.407391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.452673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45da1728-0f75-4238-a8f7-abd9a1eacd91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622014 Jun 29 10:01:51.453156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 236/508] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:01:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:01:51.465871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd939449-d964-4fdd-bb6f-98d47ad9a283 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:51.466818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd939449-d964-4fdd-bb6f-98d47ad9a283 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:51.530839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd939449-d964-4fdd-bb6f-98d47ad9a283 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:51.539638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd939449-d964-4fdd-bb6f-98d47ad9a283 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1219 microversion: 2.1 time: 0.079233 Jun 29 10:01:51.549957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 237/509] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:51.644989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:51.653213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e505eddc-c2e7-4f9f-87d1-fc64f47ea67c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1546 microversion: 2.1 time: 0.264701 Jun 29 10:01:51.653984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 273/510] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:51 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1546 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:51.899201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:51.899810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:51.906986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.907442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:51.908310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:51.908749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:52.080087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:52.091700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:52.095172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:52.097158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4c651a6-d6e2-4097-9c18-bc112edbe000 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.201631 Jun 29 10:01:52.097744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 238/511] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:52.561576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:52.562313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:52.570155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:52.570625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:52.571413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:52.571826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:52.645554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:52.654850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3389be9-dd22-43b0-b2d5-0cec3a981080 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1279 microversion: 2.1 time: 0.101104 Jun 29 10:01:52.655924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 274/512] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:52 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:53.115857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:53.116817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:53.124008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.124450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.125298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.125775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.246885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:53.248040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:53.255117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.255567 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.256616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.257231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.283905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:53.293611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:53.295121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:53.296374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8c03ddb6-c2b6-4ee7-9c96-55712447abb9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.184491 Jun 29 10:01:53.297188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 239/513] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:53.517604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91d8d7ce-9256-4cab-bec2-e88d698a9959 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274621 Jun 29 10:01:53.523327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 275/514] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:01:53 2022] POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:53.674087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:53.674819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:53.682185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.682674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.683602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.684048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.820649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:53.828853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cea556c6-e580-4f1d-ae5d-3b9f1b050228 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.159875 Jun 29 10:01:53.829430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 240/515] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:53.959245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-f0391b11-2d03-4ceb-8505-b8ba89e44c44 req-62f5a2d4-8788-41b5-8c7d-faca5dc953a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79b46e7-cd1e-460d-a080-132fa6764043", "tag": "34516eb4-1014-4903-8787-89e722f30c9c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:01:53.972473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f0391b11-2d03-4ceb-8505-b8ba89e44c44 req-62f5a2d4-8788-41b5-8c7d-faca5dc953a6 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:53.972919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f0391b11-2d03-4ceb-8505-b8ba89e44c44 req-62f5a2d4-8788-41b5-8c7d-faca5dc953a6 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:53.993037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-f0391b11-2d03-4ceb-8505-b8ba89e44c44 req-62f5a2d4-8788-41b5-8c7d-faca5dc953a6 service nova] Creating event network-changed:34516eb4-1014-4903-8787-89e722f30c9c for instance e79b46e7-cd1e-460d-a080-132fa6764043 on hv-cinder-76810 Jun 29 10:01:53.998478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-f0391b11-2d03-4ceb-8505-b8ba89e44c44 req-62f5a2d4-8788-41b5-8c7d-faca5dc953a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043993 Jun 29 10:01:53.999431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 276/516] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:01:54.316342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:54.316928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:54.323836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:54.324282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:54.325054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:54.325493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:54.470046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:54.480881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:54.482656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:54.483758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3ac19aff-2adb-4e20-b470-bc2427c57929 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.171590 Jun 29 10:01:54.484355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 241/517] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:54.854805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:54.855433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:54.862319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:54.862798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:54.868065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:54.868535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:55.009561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:55.017486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f07ce485-d8d8-488e-a8a8-6ca93ceb3d8f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.170567 Jun 29 10:01:55.018065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 277/518] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:54 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:55.503616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:55.504198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:55.511497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:55.511912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:55.512678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:55.513106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:55.646469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:55.656512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:55.657923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:55.659175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8cfbd94d-ec93-4cf9-b5d0-62c63536013e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.159657 Jun 29 10:01:55.659764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 242/519] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:56.034760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:56.035383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:56.042461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:56.042933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:56.043713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:56.044121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:56.181161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:56.188926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0b2ab526-a114-4ee2-a70c-089206f3b426 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.158022 Jun 29 10:01:56.189510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 278/520] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:56.678609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:56.679283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:56.685828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:56.686279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:56.687095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:56.687509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:56.826698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:56.836452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:56.837969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:56.839209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-353265c2-1568-42ec-8f65-c66df271e322 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.164648 Jun 29 10:01:56.839773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 243/521] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:57.206756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:57.207402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:57.214766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:57.215218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:57.215998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:57.216438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:57.356066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:57.364380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4e0ec55a-2f37-4833-82b0-1123dd6e81b6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.161568 Jun 29 10:01:57.364993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 279/522] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:57 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:57.857561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:57.858170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:57.864694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:57.865138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:57.865969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:57.866416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:57.999051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:58.008533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:58.010010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:58.011265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1d11432-a2f9-4838-9963-16980f593b1e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.157693 Jun 29 10:01:58.011792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 244/523] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:58.381941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:58.382510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:58.389588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:58.390044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:58.390873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:58.391309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:58.524378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:58.532665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8918ca43-afe1-494b-b921-5472c39192e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.154654 Jun 29 10:01:58.533257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 280/524] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:58 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:01:59.031324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:59.031895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:59.038339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:59.038836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:59.039623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:59.040062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:59.178323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:59.187578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:59.189220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:59.190672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7807301f-0e66-4775-96bc-19bc00ec0807 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.164442 Jun 29 10:01:59.191239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 245/525] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:01:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:01:59.549655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:59.550419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:01:59.557908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:59.558366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:59.559194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:01:59.559633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:01:59.939219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:01:59.946829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-96b3d8df-4901-4ed1-8987-3feffa526e13 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.401211 Jun 29 10:01:59.947404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 281/526] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:01:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:01:59.993574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:01:59.994074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:00.000345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.000770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.001549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.001982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.025876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8100705-053a-4b9f-b82d-887da0d81691 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/ips" status: 200 len: 150 microversion: 2.1 time: 0.036345 Jun 29 10:02:00.026457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 246/527] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:01:59 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:00.037283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db304a1d-daff-474d-802f-bdf4dad75786"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:00.038723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:00.045433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.045810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.046595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.047058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.133211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Invalid volume: volume db304a1d-daff-474d-802f-bdf4dad75786 is already attached to instances: 1ddf1295-57be-4e50-8403-e2ed8353c18c Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: POST /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/os-volume_attachments HTTP/1.1 Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 74 Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:02:00.134990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {"volumeAttachment": {"volumeId": "db304a1d-daff-474d-802f-bdf4dad75786"}} Jun 29 10:02:00.136706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: volume db304a1d-daff-474d-802f-bdf4dad75786 is already attached to instances: 1ddf1295-57be-4e50-8403-e2ed8353c18c Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '891fa3e1-cc41-4a26-955e-f0f39c734140', 'body': {'volumeAttachment': {'volumeId': 'db304a1d-daff-474d-802f-bdf4dad75786'}}} Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db304a1d-daff-474d-802f-bdf4dad75786 is already attached to instances: 1ddf1295-57be-4e50-8403-e2ed8353c18c Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:00.137772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db304a1d-daff-474d-802f-bdf4dad75786 is already attached to instances: 1ddf1295-57be-4e50-8403-e2ed8353c18c Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:00.139170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db304a1d-daff-474d-802f-bdf4dad75786 is already attached to instances: 1ddf1295-57be-4e50-8403-e2ed8353c18c Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 400 to user: Invalid volume: volume db304a1d-daff-474d-802f-bdf4dad75786 is already attached to instances: 1ddf1295-57be-4e50-8403-e2ed8353c18c {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-17ec4aff-5cb3-42db-8556-5e06a66e4ebc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103147 Jun 29 10:02:00.140803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 282/528] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:02:00 2022] POST /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:02:00.145482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:00.145988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:00.153152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.153596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.154349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.154826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.182986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:02:00.209588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:00.210558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:00.218872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:00.219901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.220575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.221696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.222301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.264867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62879ddd-f323-48ab-9779-496d182b2005 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 204 len: 0 microversion: 2.1 time: 0.122965 Jun 29 10:02:00.265441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 247/529] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:02:00 2022] DELETE /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 10:02:00.274378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:00.275110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:00.281453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.281908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.282735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.283197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.360794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:00.370046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:00.371593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:00.372769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c06ba964-94a2-46a7-90dc-4ebaa4211c83 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.167293 Jun 29 10:02:00.373333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 283/530] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:00.421563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:00.429378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d23a0266-90dd-4b41-b33a-304067e06aa6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1681 microversion: 2.1 time: 0.159386 Jun 29 10:02:00.429969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 248/531] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:00 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:00.964524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:00.965097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:00.971451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.971912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:00.972683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:00.973122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:01.112307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:01.120225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d11d3ad3-b915-40c8-98eb-93381a019f7e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.160308 Jun 29 10:02:01.120823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 284/532] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:01.390884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:01.391455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:01.393395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:01.399568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:01.400011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:01.400772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:01.401202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:01.447485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:01.448119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:01.450142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:01.455916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:01.456371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:01.457147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:01.457593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:01.478164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:01.538749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:01.548397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:01.557899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:01.559489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:01.560680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bffa6515-7780-46fe-adfc-8e052be2527f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.173920 Jun 29 10:02:01.561249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 249/533] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:01.596120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:01.604941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-842177b6-62ff-4a8e-95d7-68d9458df39b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1681 microversion: 2.1 time: 0.161837 Jun 29 10:02:01.605550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 285/534] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:01 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:02.137549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:02.138291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:02.144829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:02.145632 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:02.146132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:02.146575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:02.287242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:02.295068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a457682-36a9-4c2b-8cf7-93f344045f4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.161499 Jun 29 10:02:02.295622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 250/535] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:02.579980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:02.580533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:02.588003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:02.588455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:02.589228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:02.589697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:02.622805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:02.623417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:02.630045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:02.630731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:02.631597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:02.632337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:02.728953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:02.737816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:02.739408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:02.740970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dca0a239-1845-433b-b5a4-0db328013f92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.164730 Jun 29 10:02:02.741437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 286/536] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:02.768214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:02.776117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5c2e3f67-cee8-4efb-8bd9-5ac01366f090 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1681 microversion: 2.1 time: 0.157243 Jun 29 10:02:02.776696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 251/537] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:02 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:03.313359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:03.313859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:03.320997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.321442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.322206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.322660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.455789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:03.465263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d261bc9d-701d-428a-ac9d-74e0a3e2fee6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.155870 Jun 29 10:02:03.465857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 287/538] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:03 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:03.759759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:03.760425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:03.767011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.767467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.768226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.768692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.793557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:03.794648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:03.802485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.802975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.803852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.804324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.913908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:03.923608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:03.925234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:03.926453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c23e026d-f245-4d8e-926d-87c50aee544b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.170944 Jun 29 10:02:03.927719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 252/539] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:03.955246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:03.963927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-3337dc9e-42a8-4d77-978a-da525cc0505d req-fc9a2e6e-e7d7-4d57-b540-b99e9adb336f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "name": "network-vif-plugged", "status": "completed", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:03.964534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4fe1973c-f538-43ea-9412-799d14b12699 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1681 microversion: 2.1 time: 0.174445 Jun 29 10:02:03.965240 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 288/540] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:03 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:03.972972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3337dc9e-42a8-4d77-978a-da525cc0505d req-fc9a2e6e-e7d7-4d57-b540-b99e9adb336f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:03.973391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3337dc9e-42a8-4d77-978a-da525cc0505d req-fc9a2e6e-e7d7-4d57-b540-b99e9adb336f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:03.988686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-3337dc9e-42a8-4d77-978a-da525cc0505d req-fc9a2e6e-e7d7-4d57-b540-b99e9adb336f service nova] Creating event network-vif-plugged:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 10:02:03.994011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-3337dc9e-42a8-4d77-978a-da525cc0505d req-fc9a2e6e-e7d7-4d57-b540-b99e9adb336f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034079 Jun 29 10:02:03.995043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 253/541] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:04.482498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:04.483280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:04.489422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:04.489870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:04.490775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:04.491879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:04.724106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:04.733133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2dbd81e8-c623-43f9-aed4-93d669335574 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.254427 Jun 29 10:02:04.734009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 289/542] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:04 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:04.946475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:04.947093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:04.954181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:04.954673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:04.955430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:04.956180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:04.984644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:04.985272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:05.003114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:05.003535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:05.004357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:05.004798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:05.098383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:05.107376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:05.108877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:05.110091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-619f8f75-d3f7-4869-ab42-da0f0c1eed4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.168316 Jun 29 10:02:05.110693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 254/543] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:05.364339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:05.364956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:05.372565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:05.373005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:05.373790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:05.374216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:05.392934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:05.403410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a74fc7b8-d18c-4b53-bf16-0b2f041ca433 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1681 microversion: 2.1 time: 0.422671 Jun 29 10:02:05.404007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 290/544] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:04 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1681 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:05.521528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:05.530770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4eeb7f88-bedf-4d03-88d6-34cdb4fd70d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1592 microversion: 2.1 time: 0.170248 Jun 29 10:02:05.542118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 255/545] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1592 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:02:05.751084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:05.751807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:05.758542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:05.759398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:05.760566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:05.761218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.004098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:06.020588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4c7f07a3-0173-4145-b7d3-a2658ba812e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.274175 Jun 29 10:02:06.036034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 291/546] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:05 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:06.036542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-e1aa2c8b-8e34-4563-b370-bff7e86a5d58 req-2317920d-e31c-409c-88eb-a89ef74f418d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79b46e7-cd1e-460d-a080-132fa6764043", "name": "network-vif-plugged", "status": "completed", "tag": "34516eb4-1014-4903-8787-89e722f30c9c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:06.060729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e1aa2c8b-8e34-4563-b370-bff7e86a5d58 req-2317920d-e31c-409c-88eb-a89ef74f418d service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:06.061172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e1aa2c8b-8e34-4563-b370-bff7e86a5d58 req-2317920d-e31c-409c-88eb-a89ef74f418d service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.077395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-e1aa2c8b-8e34-4563-b370-bff7e86a5d58 req-2317920d-e31c-409c-88eb-a89ef74f418d service nova] Creating event network-vif-plugged:34516eb4-1014-4903-8787-89e722f30c9c for instance e79b46e7-cd1e-460d-a080-132fa6764043 on hv-cinder-76810 Jun 29 10:02:06.086498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-e1aa2c8b-8e34-4563-b370-bff7e86a5d58 req-2317920d-e31c-409c-88eb-a89ef74f418d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055272 Jun 29 10:02:06.087542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 256/547] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:02:06.102948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a9ae49cc-5197-4464-be86-743fd144aa8e req-e62f743b-5ebf-48b5-82e4-da37dfc4e626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891fa3e1-cc41-4a26-955e-f0f39c734140", "name": "network-vif-deleted", "tag": "2b5523f6-bdee-4288-a37a-576256b2182d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:06.136647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a9ae49cc-5197-4464-be86-743fd144aa8e req-e62f743b-5ebf-48b5-82e4-da37dfc4e626 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:06.141367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a9ae49cc-5197-4464-be86-743fd144aa8e req-e62f743b-5ebf-48b5-82e4-da37dfc4e626 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.141740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:06.142470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:06.156959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:06.159959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:06.160841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.161663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:06.162854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.175585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a9ae49cc-5197-4464-be86-743fd144aa8e req-e62f743b-5ebf-48b5-82e4-da37dfc4e626 service nova] Creating event network-vif-deleted:2b5523f6-bdee-4288-a37a-576256b2182d for instance 891fa3e1-cc41-4a26-955e-f0f39c734140 on hv-cinder-76810 Jun 29 10:02:06.183862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a9ae49cc-5197-4464-be86-743fd144aa8e req-e62f743b-5ebf-48b5-82e4-da37dfc4e626 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084945 Jun 29 10:02:06.198188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 292/548] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:06.421914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:06.422911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:06.431087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:06.431949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.432993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:06.433753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:06.520561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:06.529310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9399a9db-2c4f-4d5f-9719-8835c2fb21bf tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 200 len: 1614 microversion: 2.1 time: 0.111640 Jun 29 10:02:06.529904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 293/549] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:06 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:06.666387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:06.675813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:06.677281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:06.678511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c7a4347-3261-4ff8-8a24-036bc76a7756 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.551658 Jun 29 10:02:06.689444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 257/550] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:07.042768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:07.043487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:07.050736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:07.051198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:07.051991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:07.052423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:07.554393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:07.564884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-002ab656-66ec-47bf-b596-e6a88d177180 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.526190 Jun 29 10:02:07.566076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:07.568627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:07.578266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 294/551] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:07 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:07.598097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:07.598888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:07.600338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:07.600970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:07.626545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 HTTP/1.1 Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:02:07.629554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:02:07.631516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '891fa3e1-cc41-4a26-955e-f0f39c734140'} Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:02:07.632408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:02:07.633976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:02:07.636820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:02:07.637963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ab28d86-9b28-4f35-a3d4-cd9ccd4a8a86 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 404 len: 111 microversion: 2.1 time: 0.093999 Jun 29 10:02:07.639154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 258/552] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:07 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:02:07.647661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1311e9b0-a5bc-4aea-825d-a6a73ec3790e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '.version_select at 0x7f38701ec550>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:07.681620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1311e9b0-a5bc-4aea-825d-a6a73ec3790e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755911790" status: 202 len: 0 microversion: 2.1 time: 0.038149 Jun 29 10:02:07.686330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 295/553] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Jun 29 10:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755911790 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:02:07.697454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:07.698605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:07.706583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:07.707492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:07.708497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:07.710520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:08.018165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:08.029430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:08.031415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:08.032875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5209430-194d-4985-a35b-c4dbaa99ba3b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1809 microversion: 2.20 time: 0.339494 Jun 29 10:02:08.061527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 259/554] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1809 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:02:08.249350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-470f948d-0849-41b1-8450-efb92059c819 req-0f44bb90-2c3d-4436-833b-9a8a7240b00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:08.269496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-470f948d-0849-41b1-8450-efb92059c819 req-0f44bb90-2c3d-4436-833b-9a8a7240b00b service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:08.270011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-470f948d-0849-41b1-8450-efb92059c819 req-0f44bb90-2c3d-4436-833b-9a8a7240b00b service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:08.303187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-470f948d-0849-41b1-8450-efb92059c819 req-0f44bb90-2c3d-4436-833b-9a8a7240b00b service nova] Creating event network-changed:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:02:08.313207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-470f948d-0849-41b1-8450-efb92059c819 req-0f44bb90-2c3d-4436-833b-9a8a7240b00b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069335 Jun 29 10:02:08.315803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 296/555] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:08.586861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:08.587481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:08.601907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:08.603345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:08.608596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:08.609306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:08.626945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:08.627541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:08.640185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:08.640632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:08.641416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:08.641852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:08.836178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:08.846142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ea273d00-3c6d-4cc0-a1fe-d24597af15da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.264313 Jun 29 10:02:08.847076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 260/556] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:08 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:08.902817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lazy-loading 'services' on Instance uuid 1ddf1295-57be-4e50-8403-e2ed8353c18c {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:02:09.060549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:09.061228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:09.072353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.074207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.077010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.077419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.090465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-751ee364-fc7c-449a-9c0f-3dbf90a406cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments/db304a1d-daff-474d-802f-bdf4dad75786" status: 202 len: 0 microversion: 2.1 time: 0.467857 Jun 29 10:02:09.093852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 297/557] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:02:08 2022] DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments/db304a1d-daff-474d-802f-bdf4dad75786 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:02:09.103493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:09.104988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:09.113219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.114544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.115870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.116927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.153634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ee4276ff-9361-4544-b7f9-0088bde88aa1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055114 Jun 29 10:02:09.154265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 298/558] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:02:09 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:09.296193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:09.312827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:09.314826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:09.316203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1470486-ac4e-4acf-a9e5-8a66f3798966 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1796 microversion: 2.20 time: 0.260116 Jun 29 10:02:09.318471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 261/559] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:02:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1796 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:02:09.783460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-772605098"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:09.784064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:09.794377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.794985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.795961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.796557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.863602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:09.864165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:09.870708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.871159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.871955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:09.872385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:09.939948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.network.security_group_api [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Adding security group d814962c-dac8-4d8f-930a-973866087bb7 to port 87511825-cede-4e5d-a0f9-cad98a2b6e4d Jun 29 10:02:10.018110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:10.028938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4cc22423-f926-4906-b5b5-0488c025850f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1319 microversion: 2.1 time: 0.169221 Jun 29 10:02:10.029495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 262/560] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:10.167813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:10.170596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:10.179397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:10.180357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:10.181348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:10.181948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:10.226254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3e4172a-ab5f-403c-a6c0-c7614a153032 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063756 Jun 29 10:02:10.227437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 263/561] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:02:10 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:10.321295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cf227ac7-0969-4b75-868e-81a1df3ba8b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/action" status: 202 len: 0 microversion: 2.1 time: 0.541453 Jun 29 10:02:10.322385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 299/562] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:02:09 2022] POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 10:02:10.331677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:10.332306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:10.351699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-db714a12-9cb7-414c-9b48-12a1c9884893 req-5cdc7360-6788-4247-90d9-9638d3f4a9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:10.355639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:10.356242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:10.357081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:10.359636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:10.370975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-db714a12-9cb7-414c-9b48-12a1c9884893 req-5cdc7360-6788-4247-90d9-9638d3f4a9d0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:10.371817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-db714a12-9cb7-414c-9b48-12a1c9884893 req-5cdc7360-6788-4247-90d9-9638d3f4a9d0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:10.392915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-db714a12-9cb7-414c-9b48-12a1c9884893 req-5cdc7360-6788-4247-90d9-9638d3f4a9d0 service nova] Creating event network-changed:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:02:10.403870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-db714a12-9cb7-414c-9b48-12a1c9884893 req-5cdc7360-6788-4247-90d9-9638d3f4a9d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056150 Jun 29 10:02:10.405095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 300/563] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:02:10.562319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:10.574869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-01185d1f-b768-49e0-b703-d0b9bee986a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1757 microversion: 2.1 time: 0.245846 Jun 29 10:02:10.576245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 264/564] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:10 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:11.045897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:11.046623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:11.059359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.059810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.060587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.061021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.239628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:11.240885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:11.247635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.248116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.248929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.249409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.278128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:11.283178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7c5507b-bcad-4420-9a29-85cf18ed5e9d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047662 Jun 29 10:02:11.284288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 265/565] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:02:11 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 10:02:11.284431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:11.295634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ae8fbcea-f2f6-482d-8ab7-9dec23cafb9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1507 microversion: 2.1 time: 0.253857 Jun 29 10:02:11.296322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 301/566] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:11 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:11.345822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:11.346327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:11.353468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.353914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.354925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.355558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.386413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:02:11.473565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0ca80f2-ee79-4d16-99fa-fa75a1bd8dfa tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 204 len: 0 microversion: 2.1 time: 0.131428 Jun 29 10:02:11.474940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 266/567] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:02:11 2022] DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:02:11.483394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:11.484117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:11.491089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.491475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.492370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:11.492823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:11.635058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:11.643013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dbaa3338-9464-4dc8-b413-3a061689cb4a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1680 microversion: 2.1 time: 0.164051 Jun 29 10:02:11.643595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 302/568] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:11 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:12.661372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:12.662152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:12.669386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:12.669858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:12.670591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:12.671058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:12.815535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:12.824595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25697834-ecdc-48dd-a3e7-921d25c6c556 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1680 microversion: 2.1 time: 0.167612 Jun 29 10:02:12.825199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 267/569] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:12 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:13.844195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:13.845028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:13.855154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:13.855582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:13.856577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:13.857013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:14.063449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:14.072668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-12e849cc-33ed-4c23-8d85-0016c2c3c6cb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 200 len: 1680 microversion: 2.1 time: 0.234008 Jun 29 10:02:14.073659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 303/570] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:13 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:14.447697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-78d94723-df96-4fb5-bfa6-ea2d2bbff2c2 req-a9ad50da-5fef-42cf-94b4-151cbda458fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddf1295-57be-4e50-8403-e2ed8353c18c", "name": "network-vif-deleted", "tag": "b0721056-6a1f-408b-a2d5-9b3182abad69"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:14.457406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-78d94723-df96-4fb5-bfa6-ea2d2bbff2c2 req-a9ad50da-5fef-42cf-94b4-151cbda458fa service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:14.457849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-78d94723-df96-4fb5-bfa6-ea2d2bbff2c2 req-a9ad50da-5fef-42cf-94b4-151cbda458fa service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:14.471789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-78d94723-df96-4fb5-bfa6-ea2d2bbff2c2 req-a9ad50da-5fef-42cf-94b4-151cbda458fa service nova] Creating event network-vif-deleted:b0721056-6a1f-408b-a2d5-9b3182abad69 for instance 1ddf1295-57be-4e50-8403-e2ed8353c18c on hv-cinder-76810 Jun 29 10:02:14.478316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-78d94723-df96-4fb5-bfa6-ea2d2bbff2c2 req-a9ad50da-5fef-42cf-94b4-151cbda458fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Jun 29 10:02:14.479072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 268/571] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:15.091534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:15.092154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:15.099164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:15.099590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:15.100446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:15.100863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:15.115145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c HTTP/1.1 Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:02:15.116844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:02:15.118360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '1ddf1295-57be-4e50-8403-e2ed8353c18c'} Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:02:15.119212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:02:15.120532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:02:15.121999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:02:15.121999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ffed71b5-825c-4881-be66-e9c3543f5bea tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 404 len: 111 microversion: 2.1 time: 0.030753 Jun 29 10:02:15.121999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 304/572] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:15 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 10:02:15.129078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04e1cf06-fd57-4d55-9270-65411731ff88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '.version_select at 0x7f38703a5f70>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:15.150121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04e1cf06-fd57-4d55-9270-65411731ff88 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-286085950" status: 202 len: 0 microversion: 2.1 time: 0.025885 Jun 29 10:02:15.151273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 269/573] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Jun 29 10:02:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-286085950 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 10:02:15.846723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-51e64989-c12c-41d5-bf13-a4084535b0f8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: .version_select at 0x7f3870164430>, body: {"keypair": {"name": "tempest-keypair-1333372682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEcJHqPLS+B1RLKb0K/Dwa0qMAHBNudwCJQmlMZZ16/MebfIs8XRb06fFBlWGo6q7tO8sV0jwhBvxJe+kojyPovsfo8RxnfwgZJ0il2ZlDBn9YPntSvteKJ9l6KScLR5A=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:15.851340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:15.864795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-51e64989-c12c-41d5-bf13-a4084535b0f8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:02:15.869917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-51e64989-c12c-41d5-bf13-a4084535b0f8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:02:15.895875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-51e64989-c12c-41d5-bf13-a4084535b0f8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053044 Jun 29 10:02:15.896398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 305/574] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:02:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:17.346944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2020121685", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8656fd5-64f6-4a7e-ad73-3f1c4df65b17"}], "security_groups": [{"name": "tempest-securitygroup--778917800"}], "key_name": "tempest-keypair-1333372682", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:17.453585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] validate_networks() for [('e8656fd5-64f6-4a7e-ad73-3f1c4df65b17', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:02:17.845133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:02:17.845585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:02:17.846062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:02:17.846500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:02:17.846983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:02:17.857176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:17.857622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:17.858413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:17.858884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:17.876046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:02:17.880114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:02:17.893041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:02:17.895488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:02:17.944291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79eb1412-333a-4905-997a-6499b028884b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601235 Jun 29 10:02:17.950107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 270/575] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:02:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:02:17.956286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4c34b58e-edc1-4c3c-8fc7-b45460f4d6f7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:17.956904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4c34b58e-edc1-4c3c-8fc7-b45460f4d6f7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:18.016836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4c34b58e-edc1-4c3c-8fc7-b45460f4d6f7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:18.023837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4c34b58e-edc1-4c3c-8fc7-b45460f4d6f7 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1242 microversion: 2.1 time: 0.071972 Jun 29 10:02:18.024426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 306/576] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:17 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:19.041424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:19.041990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:19.064277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:19.065235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:19.066454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:19.067266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:19.160271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:19.168557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5f57a77-5dea-44a3-802d-474fdb8a636f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1302 microversion: 2.1 time: 0.131294 Jun 29 10:02:19.169590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 271/577] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:19 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:20.186484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:20.187402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:20.200174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:20.200623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:20.201601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:20.202208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:20.230481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:20.453281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:20.462864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eed630aa-4f44-465a-8b9f-d328768646f6 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.280502 Jun 29 10:02:20.463523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 307/578] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:20 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:02:20.802234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0bd5d80c-145e-42a2-9ed7-911e218fdb8b req-99527959-5b33-4898-85e7-c3c3d4808824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76483279-456b-4e8e-ad98-55f107a9d8f5", "tag": "858910de-3c31-4e84-999b-060a7ff2278b"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:20.826532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0bd5d80c-145e-42a2-9ed7-911e218fdb8b req-99527959-5b33-4898-85e7-c3c3d4808824 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:20.827316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0bd5d80c-145e-42a2-9ed7-911e218fdb8b req-99527959-5b33-4898-85e7-c3c3d4808824 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:20.855263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0bd5d80c-145e-42a2-9ed7-911e218fdb8b req-99527959-5b33-4898-85e7-c3c3d4808824 service nova] Creating event network-changed:858910de-3c31-4e84-999b-060a7ff2278b for instance 76483279-456b-4e8e-ad98-55f107a9d8f5 on hv-cinder-76810 Jun 29 10:02:20.866177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0bd5d80c-145e-42a2-9ed7-911e218fdb8b req-99527959-5b33-4898-85e7-c3c3d4808824 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069981 Jun 29 10:02:20.866824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 272/579] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:21.481287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:21.481922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:21.489065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:21.489525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:21.490284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:21.490911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:21.644560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:21.653440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-06a56b78-53fe-4566-bbeb-93231da28b54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.175801 Jun 29 10:02:21.654820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 308/580] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:21 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:22.672930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:22.673748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:22.681050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:22.681495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:22.682280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:22.682746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:22.830361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:22.839908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df85e9b8-dd1e-45c2-8569-e6a2b4271b5a tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.172096 Jun 29 10:02:22.849310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 273/581] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:22 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:23.858868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:23.859540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:23.868321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:23.869048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:23.870757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:23.871829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:24.029552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:24.038018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a3de4ea-68b8-45a7-a3be-cdcc0d7d895b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.183690 Jun 29 10:02:24.038638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 309/582] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:23 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:02:25.061056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:25.061665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:25.072173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:25.072943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:25.074205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:25.074845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:25.235855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:25.244100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3917b2e2-acb7-4244-ad64-017bd7b6e657 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.187318 Jun 29 10:02:25.244694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 274/583] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:25 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:25.840021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-f8d47a79-745b-4ba9-a9fb-56ee08ba59c1 req-ea64ce90-7c73-4d98-bcd5-3abd0c117aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76483279-456b-4e8e-ad98-55f107a9d8f5", "name": "network-vif-plugged", "status": "completed", "tag": "858910de-3c31-4e84-999b-060a7ff2278b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:25.852620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f8d47a79-745b-4ba9-a9fb-56ee08ba59c1 req-ea64ce90-7c73-4d98-bcd5-3abd0c117aa7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:25.853284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f8d47a79-745b-4ba9-a9fb-56ee08ba59c1 req-ea64ce90-7c73-4d98-bcd5-3abd0c117aa7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:25.868349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-f8d47a79-745b-4ba9-a9fb-56ee08ba59c1 req-ea64ce90-7c73-4d98-bcd5-3abd0c117aa7 service nova] Creating event network-vif-plugged:858910de-3c31-4e84-999b-060a7ff2278b for instance 76483279-456b-4e8e-ad98-55f107a9d8f5 on hv-cinder-76810 Jun 29 10:02:25.875454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-f8d47a79-745b-4ba9-a9fb-56ee08ba59c1 req-ea64ce90-7c73-4d98-bcd5-3abd0c117aa7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039941 Jun 29 10:02:25.876549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 310/584] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:02:26.262715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:26.263449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:26.270953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:26.271541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:26.272729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:26.273171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:26.425954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:26.435040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03a57b7e-32af-44dc-8a03-2624de0f62f0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.176430 Jun 29 10:02:26.435612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 275/585] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:26 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:27.455673 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:27.456696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:27.465292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:27.465789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:27.466649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:27.467176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:27.643710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:27.659952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bf7615d3-d593-4440-ae6f-6fc24d5058e5 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1367 microversion: 2.1 time: 0.209980 Jun 29 10:02:27.660543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 311/586] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:27 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:27.675845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "965a1dfc-838b-4042-a138-287d0f25013a", "device": "/dev/sdb"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:27.677790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:27.684948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:27.685443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:27.686266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:27.686799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:27.866266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:27.888212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:28.419390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78554799-1a66-47cc-8587-f7a47ce7870b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "POST /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747411 Jun 29 10:02:28.420233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 276/587] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:02:27 2022] POST /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:02:28.678020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:28.679012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:28.681272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:28.687763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:28.688211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:28.688979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:28.689434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:28.846071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:28.855915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aab35521-7a8e-4378-9507-c0ea2b093a54 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1557 microversion: 2.1 time: 0.181781 Jun 29 10:02:28.856624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 312/588] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:28 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:28.879032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:28.879978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:28.891553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:28.892559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:28.893977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:28.894529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:29.015591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-73f8f930-0c30-4765-bc1e-53c04e265afb tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145383 Jun 29 10:02:29.016452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 277/589] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:02:28 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:30.425459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-840be4eb-8013-44a5-8820-9e2bb126daad req-96ba4787-49d0-4663-a3cc-e09b096b9e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76483279-456b-4e8e-ad98-55f107a9d8f5", "tag": "858910de-3c31-4e84-999b-060a7ff2278b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:30.446408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-840be4eb-8013-44a5-8820-9e2bb126daad req-96ba4787-49d0-4663-a3cc-e09b096b9e49 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:30.447391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-840be4eb-8013-44a5-8820-9e2bb126daad req-96ba4787-49d0-4663-a3cc-e09b096b9e49 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:30.474786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-840be4eb-8013-44a5-8820-9e2bb126daad req-96ba4787-49d0-4663-a3cc-e09b096b9e49 service nova] Creating event network-changed:858910de-3c31-4e84-999b-060a7ff2278b for instance 76483279-456b-4e8e-ad98-55f107a9d8f5 on hv-cinder-76810 Jun 29 10:02:30.485745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-840be4eb-8013-44a5-8820-9e2bb126daad req-96ba4787-49d0-4663-a3cc-e09b096b9e49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067609 Jun 29 10:02:30.486922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 313/590] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:37.674441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "146ce2d2-16b1-4574-8c89-a119f261a01f"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:37.675588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:37.677805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:37.683729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:37.684212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:37.685007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:37.685444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:39.494881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c9ae6d9c-cee4-4ac6-a3f5-7df69297aa21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.824541 Jun 29 10:02:39.495771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 278/591] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:02:37 2022] POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 194 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:02:43.728514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:43.729263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:43.734320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:02:43.735497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:43.744742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:43.745208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:43.746000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:43.746442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:43.859085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-054a87d9-47a6-408b-813e-8cd940ab522b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/action" status: 202 len: 0 microversion: 2.1 time: 0.131455 Jun 29 10:02:43.863523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 314/592] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:02:43 2022] POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:02:43.876351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:43.878247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:43.890976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:43.891931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:43.894210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:43.895142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:43.901163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:02:44.138623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:44.153956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2eb8f372-205d-4a21-821a-60ed17a20af6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1749 microversion: 2.1 time: 0.287729 Jun 29 10:02:44.155235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 279/593] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1749 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:45.180226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:45.181333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:45.188888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:45.189470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:45.190403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:45.190978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:45.407306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:45.418002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-25926649-402d-437f-9c7a-defcb8e83a0c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.244080 Jun 29 10:02:45.421699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 315/594] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:46.436853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:46.437744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:46.446027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:46.446528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:46.447457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:46.447944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:46.629298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:46.639151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb95a952-5d0b-472d-861d-6724602ac719 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.206319 Jun 29 10:02:46.639869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 280/595] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:47.658875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:47.659756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:47.667954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:47.668545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:47.669499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:47.670033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:47.842275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:47.853002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4fcf3e58-2631-4820-9947-81b51dc3eb19 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.198033 Jun 29 10:02:47.853671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 316/596] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:48.872166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:48.872903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:48.880761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:48.881529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:48.882490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:48.882971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:49.075762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:49.093047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ef1e8db-d0cb-4f7f-9b6b-efc44cb03470 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.225021 Jun 29 10:02:49.094245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 281/597] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:50.123515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:50.124624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:50.136834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:50.137594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:50.139028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:50.139791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:50.322884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:50.332079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-20df0b06-cc21-4cab-9164-826961073bb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.216628 Jun 29 10:02:50.332695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 317/598] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:51.352952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:51.353820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:51.361231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:51.361741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:51.362595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:51.363092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:51.562897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:51.572521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87de441d-e30c-45e6-a15c-5e2adb91257a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.223867 Jun 29 10:02:51.573266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 282/599] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:51 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:52.591777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:52.592497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:52.601430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:52.602315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:52.604017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:52.604806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:52.815916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:52.825116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c9f1399-6e8e-423c-9f86-45bd10933192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.237434 Jun 29 10:02:52.825723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 318/600] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:53.843859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:53.844660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:53.852470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:53.852949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:53.853849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:53.854321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:54.029500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:54.039171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2be99f25-8e59-466c-bc6d-6e8e526657c0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.199271 Jun 29 10:02:54.039801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 283/601] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:55.061164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:55.061857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:55.069502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:55.069958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:55.070787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:55.071220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:55.247609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:55.258201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1f0f2f1e-a957-4fdb-a966-3c4d1975da13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.201075 Jun 29 10:02:55.259064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 319/602] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:55 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:56.277106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:56.277865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:56.285228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:56.285683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:56.286476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:56.287672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:56.466186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:56.481504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-502b563b-90b5-4e83-a076-020cec03ba3d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.207903 Jun 29 10:02:56.483739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 284/603] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:56 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:57.506158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:57.507166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:57.515225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:57.515768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:57.516645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:57.517246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:57.699394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:57.716344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f7a1a201-ebb7-448a-8149-eeab225dbad4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.214473 Jun 29 10:02:57.717708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 320/604] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:57 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:58.737090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:58.737791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:58.745414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:58.745888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:58.746730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:58.747168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:58.936763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:02:58.948506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ff2d3f0-2047-443a-bdbd-94935c67689d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.215485 Jun 29 10:02:58.949560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 285/605] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:02:59.972231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:02:59.973196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:02:59.982082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:59.982962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:02:59.983970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:02:59.984527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.195933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:00.204673 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7a00cdde-8cca-4ca5-941b-b23b18b51f4b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.238992 Jun 29 10:03:00.205363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 321/606] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:02:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:00.298094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:00.299010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:00.306482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:00.306956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.307750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:00.308178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.345563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24fd28c5-240e-4ee0-b822-449bcccb5fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments/9f609a05-88ca-4ef0-b99a-91a72edddae2" status: 200 len: 194 microversion: 2.20 time: 0.051990 Jun 29 10:03:00.346197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 286/607] 10.222.0.52 () {60 vars in 1453 bytes} [Wed Jun 29 10:03:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments/9f609a05-88ca-4ef0-b99a-91a72edddae2 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:00.445050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:00.445555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:00.454183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:00.454936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.456062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:00.456756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.551725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lazy-loading 'services' on Instance uuid 18247887-76cd-4d14-b694-3aaa572ca574 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:03:00.653554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-11ff2a97-b11e-4b18-a51f-d98646e32c4f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments/9f609a05-88ca-4ef0-b99a-91a72edddae2" status: 202 len: 0 microversion: 2.20 time: 0.213066 Jun 29 10:03:00.654164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 322/608] 10.222.0.52 () {60 vars in 1456 bytes} [Wed Jun 29 10:03:00 2022] DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments/9f609a05-88ca-4ef0-b99a-91a72edddae2 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:03:00.663779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:00.665011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:00.672317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:00.672815 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.673689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:00.674178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:00.712486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb98f997-16ac-4b61-a736-438c77d0bc63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053413 Jun 29 10:03:00.713246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 287/609] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:01.225248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:01.226444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:01.234234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:01.234730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:01.235545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:01.235962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:01.417712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:01.427661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-af2e8f9e-2f25-476e-bd4f-040541595f64 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.206869 Jun 29 10:03:01.428303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 323/610] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:01 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:01.726463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:01.727444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:01.734854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:01.735318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:01.736100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:01.736532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:01.773771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0bc2b36d-796f-4595-8030-0ddf6f757056 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052231 Jun 29 10:03:01.774362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 288/611] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:02.447399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:02.448098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:02.460623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:02.461291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:02.462340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:02.462886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:02.651381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:02.662004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80ce543b-dde9-49e6-af52-7eef88b15570 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.219753 Jun 29 10:03:02.662943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 324/612] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:02 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:02.786441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:02.788208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:02.795363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:02.795799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:02.796602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:02.797042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:02.837442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af6d15a7-4d20-4326-a0ca-1b77892ee81c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055198 Jun 29 10:03:02.838316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 289/613] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:03.687839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:03.688763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:03.696097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:03.696548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:03.697341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:03.697772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:03.856008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:03.857508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:03.869713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:03.870497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:03.871934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:03.872704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:03.877662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:03.888738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2cb7acee-13b6-44a3-8275-c875aef91ec2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.205033 Jun 29 10:03:03.889734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 325/614] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:03 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:03.909358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ed49c7e-3b31-4260-986f-1cd148a8e12d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061623 Jun 29 10:03:03.910265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 290/615] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:04.907801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:04.908414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:04.916153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:04.916632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:04.917542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:04.917970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:04.922186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:04.923236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:04.930899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:04.931354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:04.932150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:04.932593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:04.967435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39a85a03-de25-4f73-8645-ae686db3f8b3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049643 Jun 29 10:03:04.967918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 291/616] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:05.085501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:05.093815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc61a689-d570-4a89-b594-bbe8c1acc21e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.190180 Jun 29 10:03:05.094432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 326/617] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:04 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:05.979689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:05.980814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:05.988055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:05.989224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:05.991741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:05.992236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:06.033335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9df24929-1bca-4f40-bb82-e5265fb46af2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057763 Jun 29 10:03:06.033926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 292/618] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:06.112830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:06.113448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:06.121548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:06.122114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:06.123036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:06.123555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:06.285399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:06.300488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-512668c1-3fe9-4b51-a0e9-f1c0bbae7d98 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.191346 Jun 29 10:03:06.301330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 327/619] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:07.049998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:07.051335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:07.059659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.060113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.060904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.061334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.096082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-277edb1c-3773-44d2-bc15-88f7c86beb6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053325 Jun 29 10:03:07.096740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 293/620] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:07.323650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:07.324799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:07.337491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.338268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.339737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.340602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.381397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:07.382345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:07.393597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.394846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.396281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.397464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.444659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:03:07.488214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:07.542735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ec2f8cb-db9b-4fcb-8829-3fee0ac50885 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 204 len: 0 microversion: 2.1 time: 0.168163 Jun 29 10:03:07.544139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 294/621] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:03:07 2022] DELETE /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 10:03:07.558329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:07.559591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:07.570960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.571760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.573226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:07.574037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:07.590414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:07.594980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:07.600852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-66be3981-2436-436b-a9b6-93ed8b6ce401 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.284807 Jun 29 10:03:07.601467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 328/622] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:07 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:07.762214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:07.770510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4ffd9ce3-3285-45cc-b586-c48afdf8ff7d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.220789 Jun 29 10:03:07.771168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 295/623] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:07 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:08.109264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:08.110333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:08.118851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:08.119205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:08.119991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:08.120426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:08.157469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-40f8ca84-ad3b-4e24-8f7e-953db8ba047c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052366 Jun 29 10:03:08.158139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 329/624] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:08.620892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:08.621552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:08.624086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:08.630248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:08.630829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:08.631653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:08.632090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:08.790313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:08.791240 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:08.800188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:08.800797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:08.801693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:08.802462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:08.811821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:08.825970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d6dd1a8-a4f5-4504-b2ab-f618c48cb7fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.208992 Jun 29 10:03:08.826608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 296/625] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:08.985595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:08.994856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c823b4cf-ce21-475d-8322-39608d9a2896 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.209427 Jun 29 10:03:08.995469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 330/626] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:08 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:09.172821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:09.173817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:09.181699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:09.182176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:09.183032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:09.183478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:09.219625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1512714a-aa08-469b-8c3e-8ba709c2b395 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051121 Jun 29 10:03:09.220219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 297/627] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:09.342704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:09.343491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:09.353712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:09.354414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:09.355688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:09.356349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:09.396686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6069a844-155e-424d-b6f1-8b1983d6c7ce tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5/ips" status: 200 len: 150 microversion: 2.1 time: 0.060403 Jun 29 10:03:09.397682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 331/628] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:03:09 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5/ips => generated 150 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:03:09.845719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:09.846334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:09.855748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:09.856273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:09.857454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:09.857947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:10.017935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:10.019196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:10.032783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:10.033573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:10.034965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:10.035617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:10.060850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:10.075405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5fdd0f8-c24a-4a5e-b084-76ec56748b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.233442 Jun 29 10:03:10.076385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 298/629] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:09 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:10.234233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:10.235806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:10.244169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:10.244712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:10.245573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:10.246067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:10.256744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:10.264800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a80dee01-773f-4047-95b6-34cdf66ade63 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.254787 Jun 29 10:03:10.265392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 332/630] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:10 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:10.291757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-074f7fbc-874e-429b-8d18-c4478e5e9a17 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063880 Jun 29 10:03:10.292353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 299/631] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:11.101500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:11.102124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:11.109608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:11.110074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:11.110885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:11.111329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:11.284358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:11.285505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:11.290971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:11.293640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:11.294232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:11.295245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:11.295952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:11.306739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-335c5225-9e29-494d-93e5-3ef0d9c9eb10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.208934 Jun 29 10:03:11.307791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 333/632] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:11.316771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:11.318376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:11.330710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:11.331509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:11.332957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:11.334844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:11.391649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c5705bfe-f427-4e02-9a76-035feb32b7b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081940 Jun 29 10:03:11.392662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 334/633] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:11.448280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:11.457475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e9701d4-0b34-4765-93c3-5965ccee4842 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.177817 Jun 29 10:03:11.458263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 300/634] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:11 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:12.329953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:12.330886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:12.338931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:12.339367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:12.340165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:12.340605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:12.408830 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:12.410510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:12.419349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:12.419920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:12.420709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:12.421338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:12.456679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5f373493-f0ed-475b-b967-9dc2d54edd82 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055522 Jun 29 10:03:12.457279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 301/635] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:12.477708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:12.478331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:12.484954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:12.485425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:12.486193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:12.486668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:12.509224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:12.517481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df6502aa-71eb-48ad-8d3f-5abe3c456a79 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.191628 Jun 29 10:03:12.518081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 335/636] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:12 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:12.643045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:12.652021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-517563d5-48c6-4a6a-9a0a-4a6b5e779c61 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.178598 Jun 29 10:03:12.652607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 302/637] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:12 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:13.473246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:13.474418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:13.482055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:13.482594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:13.483456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:13.483931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:13.519027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80955198-f712-44ac-885d-3fceeebd9279 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049912 Jun 29 10:03:13.519640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 336/638] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:13.536108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:13.536980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:13.546819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:13.547327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:13.548263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:13.548858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:13.670019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:13.670658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:13.677783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:13.678254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:13.679078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:13.679538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:13.754379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:13.767460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a286c2a4-5e99-49a1-9dd1-f7e0c32ac642 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.234863 Jun 29 10:03:13.768781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 303/639] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:13 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:13.838974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:13.847502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-04082995-45e8-47e4-af63-d50b1870f42b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.181400 Jun 29 10:03:13.848099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 337/640] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:13 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:14.531542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:14.532465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:14.539681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:14.540388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:14.540892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:14.541356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:14.574055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-65d25367-ac07-4b95-a7ea-346388578b0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046552 Jun 29 10:03:14.574651 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 304/641] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:14.785945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:14.786638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:14.789031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=49 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:14.794927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:14.795387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:14.796162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:14.796591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:14.867766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:14.868543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:14.875394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:14.875851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:14.876820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:14.877467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:14.968765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:14.983934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-33d04e61-e9b1-4128-88b2-a00b38ddc301 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.201719 Jun 29 10:03:14.985376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 338/642] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:14 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:15.051719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:15.063991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f99f7bd9-e038-4e51-a40c-b3e03c99abec tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.200963 Jun 29 10:03:15.065015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 305/643] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:14 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:15.586844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:15.587811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:15.595199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:15.595657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:15.596614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:15.597055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:15.631084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-081743fc-3e6f-459b-b539-13de2766b001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048906 Jun 29 10:03:15.631694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 339/644] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:16.013131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:16.013734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:16.021283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:16.022095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:16.022918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:16.023360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:16.094624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:16.095800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:16.108333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:16.115490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:16.117164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:16.117736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:16.203275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:16.215763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b141f454-9d2a-4ed4-98d5-c88ab762704a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.206526 Jun 29 10:03:16.216843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 306/645] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:16.287163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:16.298436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-663b2781-3fe0-4da7-9c25-caaf3ea3d053 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.209816 Jun 29 10:03:16.299517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 340/646] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:16 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:16.643886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:16.644739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:16.652119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:16.652537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:16.653348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:16.653774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:16.689352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1980e845-2d5b-4c6a-b102-938b0997615b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049556 Jun 29 10:03:16.689946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 307/647] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:17.244625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:17.245570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:17.253463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:17.253996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:17.254888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:17.255456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:17.325205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:17.326768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:17.338824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:17.339847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:17.341428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:17.342037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:17.433921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:17.448492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3179553d-46e7-4524-a86b-bdb4f5e8965b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.208669 Jun 29 10:03:17.449561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 341/648] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:17.503735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:17.520211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dad3aa4d-3b62-46dd-9988-8fa47d668196 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.199729 Jun 29 10:03:17.520990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 308/649] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:17 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:17.701079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:17.702213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:17.710036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:17.710508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:17.711368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:17.711782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:17.746285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f24d775c-a212-422f-ad39-1774c13cc09b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049262 Jun 29 10:03:17.747005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 342/650] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:18.467622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:18.468267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:18.476427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:18.477031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:18.477977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:18.478528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:18.540365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:18.541235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:18.553836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:18.554664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:18.556037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:18.556793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:18.670945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:18.686160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89830ba9-fa43-4f8f-9e0c-617869cd4bfd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.222467 Jun 29 10:03:18.687215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 309/651] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:18.731108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:18.739586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c307ee39-b1f2-4662-8b1c-81abaccc1055 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.204932 Jun 29 10:03:18.740765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 343/652] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:18 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:18.764086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:18.765710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:18.777039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:18.777835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:18.779325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:18.780111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:18.819588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:18.827091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f232e13-eec9-4e00-8af7-caea87ba6389 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070835 Jun 29 10:03:18.827677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 310/653] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:19.713675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:19.714635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:19.721333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:19.721862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:19.723079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:19.723656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:19.759196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:19.759915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:19.767574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:19.768029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:19.768822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:19.769260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:20.061666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:20.075231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a57ed8b-f4ed-4893-8e8f-e09f879828f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.321393 Jun 29 10:03:20.075979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 311/654] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:19 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:20.081469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:20.082536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:20.090898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:20.091225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:20.092120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:20.092556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:20.131545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-590c2f99-3e68-4b5a-a579-cf706f88c3a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053697 Jun 29 10:03:20.132758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 312/655] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:20.229549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:20.245351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-075fc68b-525f-4ffb-b8e9-9a20ce8bf866 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.536549 Jun 29 10:03:20.246267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 344/656] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:21.100709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:21.101462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:21.108881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:21.109329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:21.110122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:21.110556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:21.147336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:21.148980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:21.161228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:21.162105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:21.163309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:21.163854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:21.203401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:21.208427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4d2a3ce7-bd9d-47e4-8866-f2a43de95ef7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066715 Jun 29 10:03:21.209382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 345/657] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:21.272135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:21.273316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:21.275345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:21.288242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b260d1ec-5780-41eb-88ab-f7b23b4bc005 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.191639 Jun 29 10:03:21.289166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 313/658] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:21 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:21.291786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:21.292260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:21.293145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:21.293594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:21.542970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:21.551668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e92e986c-8642-444e-877e-5460f76294b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.284981 Jun 29 10:03:21.553925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 346/659] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:22.224566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:22.225807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:22.233438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:22.233963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:22.234793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:22.235223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:22.271160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e71c77a-9ae1-4b38-a4ae-27640961e91b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050797 Jun 29 10:03:22.271632 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 314/660] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:22.306757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:22.307501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:22.315505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:22.316017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:22.316783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:22.317214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:22.469497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:22.488129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7656a9a2-e096-4d1b-97b7-4289325a9d29 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.181532 Jun 29 10:03:22.488129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 347/661] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:22 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:22.581276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:22.581823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:22.593748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:22.594543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:22.595955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:22.596684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:22.781531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:22.791750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-314374db-506a-4b33-abde-380c4beb582e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.217967 Jun 29 10:03:22.792356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 315/662] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:22 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:23.284121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:23.284952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:23.293375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:23.293822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:23.294609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:23.295067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:23.332061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d634a984-1cb2-42a7-9f96-19e7b4b59537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052166 Jun 29 10:03:23.332774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 348/663] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:23.510402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:23.511025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:23.517986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:23.518434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:23.519253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:23.519676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:23.710619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:23.719712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ab2d3049-2b80-406d-b144-f4f1547e4e9b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.213815 Jun 29 10:03:23.720281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 316/664] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:23 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:23.809839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:23.810365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:23.817829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:23.818316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:23.819147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:23.819617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:23.991799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:24.000346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70cd4f70-1e12-46a9-b14b-96402e9a3013 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.194553 Jun 29 10:03:24.000960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 349/665] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:24.345364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:24.346342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:24.353406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:24.353850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:24.354671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:24.355110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:24.391800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-52c6c3f7-4703-4b6a-befe-c4719e8cce29 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050529 Jun 29 10:03:24.392392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 317/666] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:24.738379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:24.739233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:24.747579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:24.748023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:24.748790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:24.749226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:24.903360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:24.913571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-813f97eb-eda7-42a0-8a4c-684657fcef62 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.179372 Jun 29 10:03:24.914073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 350/667] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:24 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:25.019577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:25.020268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:25.027794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:25.028134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:25.028911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:25.029347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:25.193956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:25.203133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0b3581e-8ed2-48da-b83d-41e7556c7e49 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.187514 Jun 29 10:03:25.203677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 318/668] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:25 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:25.403875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:25.404720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:25.411563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:25.411988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:25.412817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:25.413253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:25.446381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-09f53b92-8761-45aa-93cd-9eb8fd78cdfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046595 Jun 29 10:03:25.447017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 351/669] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:25.931998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:25.932619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:25.939608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:25.940055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:25.940824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:25.941262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:26.093460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:26.103016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da642aa0-9d37-43bb-9134-78fec5d4e228 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.175590 Jun 29 10:03:26.103659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 319/670] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:25 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:26.222476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:26.223425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:26.231269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:26.231714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:26.232480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:26.232915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:26.394279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:26.404423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19cd8822-c1cf-4674-9de9-990d1f8250ce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.186577 Jun 29 10:03:26.405037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 352/671] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:26 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:26.459260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:26.460396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:26.467121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:26.467675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:26.468572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:26.469137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:26.511551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-329aa4f3-6860-46e0-b6eb-88c5a6c743cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057572 Jun 29 10:03:26.512152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 320/672] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:27.123072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:27.123890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:27.133858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:27.134308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:27.135124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:27.135561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:27.275447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:27.285982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a4c6e0ed-ae8c-4309-8160-c4efb8a10082 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.168376 Jun 29 10:03:27.287046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 353/673] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:27 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:27.433480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:27.434133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:27.441550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:27.442079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:27.443030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:27.443452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:27.523958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:27.524928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:27.531886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:27.532344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:27.533107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:27.533531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:27.569335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5ac124c0-a049-4b67-882c-f389cf680ee8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048453 Jun 29 10:03:27.569335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 354/674] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:27.628605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:27.640801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8327b39e-35fb-4a53-afee-a059664be70b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.211282 Jun 29 10:03:27.641398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 321/675] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:28.306345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:28.306960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:28.316236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:28.317142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:28.319006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:28.319914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:28.472836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:28.483157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b8c6f5c0-0444-4e59-9f73-775bfa3ff65e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.180884 Jun 29 10:03:28.483796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 355/676] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:28 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:28.581416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:28.582602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:28.590100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:28.590581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:28.591400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:28.591828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:28.626492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c85f6253-3821-4f60-8227-30cee8b334b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049969 Jun 29 10:03:28.627189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 322/677] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:28.659185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:28.659816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:28.666461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:28.666950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:28.667719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:28.668156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:28.823508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:28.832714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-000a05b0-0676-4f01-aa4c-ec9b96ac0b48 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.177698 Jun 29 10:03:28.833285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 356/678] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:29.501361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:29.501978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:29.508951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:29.509405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:29.510205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:29.510720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:29.644498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:29.646237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:29.655381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:29.655905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:29.656772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:29.657266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:29.681015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:29.692387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-057f4b74-9965-4aec-8407-affa2b841d21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055174 Jun 29 10:03:29.693056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 357/679] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:29.695136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9d90830-8193-441a-838b-b948c0d6ab8f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.197064 Jun 29 10:03:29.696174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 323/680] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:29 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:29.853734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:29.854427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:29.861217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:29.861665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:29.862443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:29.862905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:30.037262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:30.046721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef5f8a19-fa75-473b-8a08-8db45cdfa346 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.199278 Jun 29 10:03:30.047319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 358/681] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:29 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:30.705610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:30.706603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:30.714677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:30.715121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:30.715904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:30.716079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:30.716599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:30.717017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:30.728934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:30.729728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:30.730995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:30.731780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:30.752717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ff67548-5fca-49b7-880c-aedfdb835625 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051114 Jun 29 10:03:30.753533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 324/682] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:30.889443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:30.898680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-914e3c54-8880-4093-b9b5-e08038303cfd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.188822 Jun 29 10:03:30.899412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 359/683] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:30 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:31.070403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:31.071588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:31.081561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:31.082301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:31.083196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:31.084216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:31.272493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:31.281524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3629b153-73d8-4884-8f5e-111c447a77b5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.217490 Jun 29 10:03:31.282140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 325/684] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:31.766028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:31.767006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:31.775990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:31.776566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:31.777704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:31.778143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:31.814421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-88d48759-d081-4751-b7d9-027642cb91a8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052432 Jun 29 10:03:31.815056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 360/685] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:31.915950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:31.916554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:31.924110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:31.924562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:31.925354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:31.925802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:32.103963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:32.112275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-236c394c-430d-4481-88e8-98e7a9f7afda tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.200188 Jun 29 10:03:32.112874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 326/686] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:31 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:32.308248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:32.308775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:32.316174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:32.316633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:32.317415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:32.318082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:32.484453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:32.493975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3e65db53-53b7-4c9d-994f-6940df7e2e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.190152 Jun 29 10:03:32.494587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 361/687] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:32 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:32.829244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:32.830201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:32.838596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:32.839058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:32.839870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:32.840307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:32.856568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:32.876153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-013b0fdb-ecb2-47fb-8df8-a29c7e81a228 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051052 Jun 29 10:03:32.876753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 327/688] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:33.134427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:33.135756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:33.145783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:33.146335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:33.147420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:33.148180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:33.170555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:33.328612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:33.339851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d1f75061-bdb3-484d-83bd-69a77dc29ec4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.212665 Jun 29 10:03:33.340960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 362/689] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:33 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:33.516350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:33.517002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:33.525043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:33.525490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:33.526275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:33.526756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:33.692055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:33.701671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f197825-6db9-49cf-a669-c85b71b2927d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1754 microversion: 2.1 time: 0.189300 Jun 29 10:03:33.702288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 328/690] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:33 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:34.026852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:34.027973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:34.035310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:34.035816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:34.037590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:34.038180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:34.074705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b435ef3-e9ff-407a-82d3-a1bbf7505de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189709 Jun 29 10:03:34.075319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 363/691] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:34.358609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:34.359228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:34.367214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:34.367653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:34.368446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:34.368881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:34.511348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:34.519873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-030a0e52-9148-490e-8ff7-6a3026669bdc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.165944 Jun 29 10:03:34.521300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 329/692] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:34 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:34.729525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:34.738924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:34.755307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:34.756371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:34.758333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:34.759186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:34.976115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:34.985523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9da89a3b-728e-4acd-899c-094365a4881e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1757 microversion: 2.1 time: 0.267840 Jun 29 10:03:34.986274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 364/693] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1757 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:35.092245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:35.093834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:35.106120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:35.106969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:35.108384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:35.109141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:35.168402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54093b4f-72d1-403a-ac07-080508bcafe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084518 Jun 29 10:03:35.169384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 330/694] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:35.539073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:35.539587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:35.546230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:35.546708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:35.547488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:35.547895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:35.702082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:35.710838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-24f62a13-2d97-4fa0-a4dd-e271a2b50783 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.176743 Jun 29 10:03:35.711465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 365/695] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:35 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:36.188077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:36.189277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:36.201136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.203249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.204987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.205754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.260325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb6d269f-003b-4afc-a72e-71a9fc000ade tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080098 Jun 29 10:03:36.261114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 331/696] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:36.435893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:03:36.437642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:36.451212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.452248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.454039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.455103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.498311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'flavor' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:03:36.665831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7a7929fe-20bd-4f40-90cb-92b188aeb828 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/action" status: 200 len: 32 microversion: 2.1 time: 0.236204 Jun 29 10:03:36.671046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 366/697] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:03:36 2022] POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 10:03:36.681780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:36.687326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:36.702980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.703769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.704829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.705504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.733236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:36.734395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:36.742618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.743892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.745283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:36.746762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:36.880502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:36.889445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da85aaee-9f1a-445b-8c7a-8dbe2d0a19f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.214620 Jun 29 10:03:36.890391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 332/698] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:37.055012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:37.063477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0a5fc5c6-f68d-4374-a278-f65c7b863742 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1579 microversion: 2.1 time: 0.335022 Jun 29 10:03:37.064296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 367/699] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:36 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1579 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:37.285563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:37.288473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:37.301503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:37.303370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:37.304666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:37.305255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:37.373445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-68f762ad-94cd-432e-a3b9-50a8303b2d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103765 Jun 29 10:03:37.374516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 333/700] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:37.737115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-2309a850-ab4a-4294-914a-60acef30e12f req-d58a3239-58cd-40ac-99a8-a2220fdcdeae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bac0f78-62e4-4cd7-a3c4-5db0831d274b", "name": "network-vif-deleted", "tag": "1927ed3c-4a6c-4cd4-980d-0f750cc50d93"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:03:37.758390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-2309a850-ab4a-4294-914a-60acef30e12f req-d58a3239-58cd-40ac-99a8-a2220fdcdeae service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:37.758898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-2309a850-ab4a-4294-914a-60acef30e12f req-d58a3239-58cd-40ac-99a8-a2220fdcdeae service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:37.772651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-2309a850-ab4a-4294-914a-60acef30e12f req-d58a3239-58cd-40ac-99a8-a2220fdcdeae service nova] Creating event network-vif-deleted:1927ed3c-4a6c-4cd4-980d-0f750cc50d93 for instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b on hv-cinder-76810 Jun 29 10:03:37.779463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-2309a850-ab4a-4294-914a-60acef30e12f req-d58a3239-58cd-40ac-99a8-a2220fdcdeae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045673 Jun 29 10:03:37.780682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 368/701] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:03:37.912748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:37.913953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:37.925446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:37.926573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:37.928439 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:37.929472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:38.089512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:38.091152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:38.105622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:38.106823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:38.108456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:38.110679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:38.138697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:38.148475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d80ca16-f520-483e-8418-50b794e2c56d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.244422 Jun 29 10:03:38.149091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 334/702] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:38.210884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:38.219179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3300b5a1-8b92-429d-838e-1ddaa59644f1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.139873 Jun 29 10:03:38.220045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 369/703] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:38.392901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:38.394601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:38.405967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:38.406835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:38.408282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:38.409122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:38.467479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b82b7fcc-b6c3-4eb4-b608-f8f2d832f96d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082314 Jun 29 10:03:38.468512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 335/704] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:39.167479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:39.168170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:39.175227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:39.175681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:39.176470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:39.177380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:39.237504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:39.238373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:39.240936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:39.247764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:39.248437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:39.249434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:39.250009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:39.339905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:39.350409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f187e73c-af96-40f7-88d4-6f5ab4cf94d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.186967 Jun 29 10:03:39.351255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 370/705] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:39.483287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:39.484590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:39.492421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:39.492873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:39.493677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:39.494115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:39.531202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-65bab8d9-ea67-44ba-98d4-0521ef799f21 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052332 Jun 29 10:03:39.531809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 371/706] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:39.582431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:39.591071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efb459fd-5153-49ca-a6bd-e4d7534ffc3c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.358079 Jun 29 10:03:39.591733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 336/707] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:39 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:40.245969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:03:40.246637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:03:40.503681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:40.504330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:40.511752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:40.512197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:40.512985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:40.513417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:40.545904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:40.547411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:40.560863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:40.561603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:40.563064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:40.563821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:40.624288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ce4fcbf-87c4-4418-bf52-282955590f4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082358 Jun 29 10:03:40.629417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 337/708] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:40.633991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:40.634787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:40.643217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:40.643981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:40.645371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:40.646145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:40.713039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:40.722654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c70b0edf-430a-4e94-8b2a-5679210ab452 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.350229 Jun 29 10:03:40.723389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 372/709] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:40.740875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:40.755797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93f23251-afc2-4e61-870a-8a63936503e3 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.128201 Jun 29 10:03:40.757030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 338/710] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:40 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:41.638062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:41.639221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:41.646774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:41.647306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:41.648122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:41.648559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:41.682471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1f9e0f5c-ec23-4a7c-8aa9-e63c009dac87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048469 Jun 29 10:03:41.683108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 373/711] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:41.742013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:41.742767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:41.750652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:41.751109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:41.751926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:41.752364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:41.774029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:41.774868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:41.784681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:41.785373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:41.786763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:41.787486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:41.868842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:41.883138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-013f57fb-cff6-4c77-9d01-209b799d2276 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.113679 Jun 29 10:03:41.884128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 374/712] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:41 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:41.918979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:41.928819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c0604a5-6806-46f0-a23b-c5e9665adb9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.191278 Jun 29 10:03:41.929565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 339/713] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:42.696895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:42.698025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:42.705996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:42.706435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:42.707339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:42.707772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:42.747072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f20f6c53-fc9c-442a-8564-8f745a16b240 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054518 Jun 29 10:03:42.747660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 375/714] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:42.907894 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:42.908889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:42.921915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:42.922414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:42.923741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:42.924175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:42.946746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:42.947447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:42.954098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:42.954553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:42.955374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:42.955928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:43.022256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:43.033933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c2153c9-3de7-4b6e-a728-d873ece9f87b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.129979 Jun 29 10:03:43.034546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 340/715] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:42 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:43.119508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:43.128396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-778fc477-f507-46cd-b4af-adcea91b1f21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.185915 Jun 29 10:03:43.129011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 376/716] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:43.760149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:43.761122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:43.768117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:43.768640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:43.769498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:43.769951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:43.804215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54b83de8-e4bc-4c7e-b587-9a9ee69b26e0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048298 Jun 29 10:03:43.804820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 341/717] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:44.056891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:44.057600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:44.064548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:44.065162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:44.066263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:44.066818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:44.136971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:44.143313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:44.147247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f9ce2f94-7bf0-4925-b7cf-98c5fa9d2184 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.095362 Jun 29 10:03:44.147849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 377/718] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:44 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:44.157385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:44.158441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:44.166856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:44.167304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:44.168137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:44.168577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:44.319186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:44.334932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37351028-d5f9-4ef8-8851-9656d83d4611 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.180384 Jun 29 10:03:44.336029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 342/719] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:44.817446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:44.818803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:44.821458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=80 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:44.829295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:44.829710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:44.830499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:44.830970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:44.866600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3727286e-30d0-429f-b81c-902fdf16cc93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053446 Jun 29 10:03:44.867220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 378/720] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:45.164969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:45.165600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:45.173080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:45.173531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:45.174314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:45.174783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:45.245213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:45.259140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-db0dd051-1317-425b-a887-5f38bc26c4ef tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.098070 Jun 29 10:03:45.260176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 343/721] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:45 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:45.352707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:45.353550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:45.360443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:45.360895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:45.361675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:45.362112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:45.510447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:45.518998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b74f83f6-fc23-4502-ba61-9d40402eeb10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170344 Jun 29 10:03:45.519587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 379/722] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:45.882109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:45.883990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:45.892834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:45.893296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:45.894088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:45.894530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:45.897484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:45.932617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8a4ff57-0d76-4dc4-b719-d412a7c0dec9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053526 Jun 29 10:03:45.933446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 344/723] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:46.286052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:46.287106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:46.294854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:46.295388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:46.296280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:46.296768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:46.383836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:46.392969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2881fdf6-dc5b-4ff5-a26b-d61bdce1abc9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.112973 Jun 29 10:03:46.393816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 380/724] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:46 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:46.540080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:46.540689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:46.548520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:46.549101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:46.550338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:46.550814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:46.740230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:46.750530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9d213975-49b9-4014-a7a1-c10a58379749 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.217314 Jun 29 10:03:46.751195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 345/725] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:46.946197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:46.947171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:46.954958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:46.955568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:46.956391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:46.956836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:46.992931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-385bacda-705a-4dd6-99d8-653d5271bf28 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051696 Jun 29 10:03:46.993680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 381/726] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:47.490385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:47.491146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:47.498077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:47.498520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:47.499317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:47.499746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:47.593900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:47.606158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12303a1c-3b70-4026-8419-cba2d1a2a647 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.120408 Jun 29 10:03:47.606941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 346/727] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:47 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:47.768910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:47.769737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:47.777022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:47.777529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:47.778395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:47.778958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:47.936111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:47.945293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3e73b1ff-1ff5-4d38-9339-25da9eb5e6ab tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.180454 Jun 29 10:03:47.945924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 382/728] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:48.005544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:48.006525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:48.013501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:48.013977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:48.014813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:48.015253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:48.049464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8d3b40e-b145-4126-b3f8-43c513a60286 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048009 Jun 29 10:03:48.049958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 347/729] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:48.625969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:48.626600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:48.633554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:48.634037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:48.634886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:48.635320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:48.714858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:48.726927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d392a0f8-435b-4bae-88ce-57bc0557d1bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.104969 Jun 29 10:03:48.727796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 383/730] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:48 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:48.969130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:48.970057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:48.977674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:48.978127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:48.978934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:48.979360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:49.062234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:49.063281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:49.072032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:49.072544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:49.073524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:49.074064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:49.112875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4ab0bf65-a372-4111-8a4e-699086d1b31b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054671 Jun 29 10:03:49.113491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 384/731] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:49.169108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:49.179046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a081a329-5307-43e4-8985-6e4b48193916 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.217774 Jun 29 10:03:49.179646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 348/732] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:49.747813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:49.748523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:49.756358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:49.756935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:49.757850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:49.758389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:49.831516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:49.840620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a052d61-b0be-43d1-935c-a1cb6da9c31f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.097255 Jun 29 10:03:49.841333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 385/733] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:49 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:50.130113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:50.131914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:50.143235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:50.144021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:50.145481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:50.146263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:50.211464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:50.212587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-080285f9-e4eb-4431-b5e2-59c2f407d095 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088738 Jun 29 10:03:50.212844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:50.213342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 349/734] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:50.224958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:50.225713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:50.227130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:50.227692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:50.426911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:50.435743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b090ac37-cae5-4694-9817-e607ae5b9ec3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.233120 Jun 29 10:03:50.436326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 386/735] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:50.862775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:50.863664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:50.873299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:50.873944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:50.875157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:50.875820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:50.958356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:50.967711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1497ef6a-58dd-4a28-bc72-df26cfb4d84b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.112322 Jun 29 10:03:50.968413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 350/736] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:50 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:51.226523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:51.227866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:51.236343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:51.236931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:51.237920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:51.238453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:51.295552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d6d543bb-71c9-4f93-951f-d32b4a173951 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073493 Jun 29 10:03:51.296141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 387/737] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:51.456927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:51.457595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:51.466086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:51.466580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:51.467408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:51.467932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:51.645682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:51.660385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92c6d2a2-4582-4292-8854-289c6ee7ec53 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.207797 Jun 29 10:03:51.661456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 351/738] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:51.986590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:51.987353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:51.995118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:51.995613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:51.996578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:51.997115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:52.080803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:52.095504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-686a4c01-89c6-4d29-9b24-f80e59a598b9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.112685 Jun 29 10:03:52.096576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 388/739] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:51 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:52.310274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:52.311483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:52.320829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:52.320829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:52.321625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:52.322399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:52.376099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8ac5d4b-58af-49c5-812a-23399bc38694 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071176 Jun 29 10:03:52.376867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 352/740] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:52.688155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:52.689156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:52.697655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:52.698148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:52.699047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:52.699517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:52.900958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:52.911307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-87eb7c1c-e873-44ea-95d3-ff24c1d4f6c7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.226948 Jun 29 10:03:52.912695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 389/741] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:53.121385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:53.122377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:53.130293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:53.130966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:53.131909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:53.132450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:53.215153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:53.229531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-736d3808-3f0d-42b2-a4ee-00a4e8cd5c80 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.112045 Jun 29 10:03:53.230532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 353/742] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:53 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:53.390773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:53.391643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:53.403497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:53.403497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:53.403497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:53.403497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:53.436075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-acd37f44-18ed-41d7-9d5a-ff8312e119b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049963 Jun 29 10:03:53.436695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 390/743] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:53.937037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:53.937858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:53.945349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:53.945799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:53.946613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:53.947056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:54.133881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:54.147761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7845afba-8f56-4a20-995b-e92379c20ea8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.214273 Jun 29 10:03:54.156823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 354/744] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:54.258894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:54.259950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:54.271536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:54.272361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:54.273798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:54.274619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:54.376203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:54.388241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5dfde50b-c0c3-40ab-a992-95b6066137ad tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.137115 Jun 29 10:03:54.389097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 391/745] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:54 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:54.450343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:54.451508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:54.460845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:54.461436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:54.462338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:54.462906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:54.503812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e375c8e5-80e7-4213-8926-5267b20573ba tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058394 Jun 29 10:03:54.504887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 355/746] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:55.169738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:55.170354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:55.178467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:55.178965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:55.179868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:55.180396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:55.343265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:55.352881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-71f91188-06ee-4b4c-a686-73ed9a0d6168 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.187045 Jun 29 10:03:55.353487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 392/747] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:55.413342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:55.414006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:55.421570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:55.422013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:55.422869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:55.423312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:55.495659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:55.504090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0de14f0e-a938-4030-8b0c-c17b3b0c4ce9 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.094727 Jun 29 10:03:55.504732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 356/748] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:55 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:55.521552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:55.522965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:55.533999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:55.534816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:55.536684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:55.537503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:55.575148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3cf8d299-ec6c-46ec-837b-945d95158a48 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061765 Jun 29 10:03:55.575631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 393/749] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:56.372212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:56.372727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:56.381135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.381820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.382826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.383450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.521984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:56.522632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:56.530100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.530530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.531361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.531791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.553294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:56.569296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:56.578710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fe3db7a7-211b-4166-b7ba-10018d24d552 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1714 microversion: 2.1 time: 0.210424 Jun 29 10:03:56.579322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 357/750] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1714 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:56.593059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:56.594935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:56.603018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:56.603858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.604313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.605105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.605541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.616875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-01b44e20-a375-42b1-a059-179e26569b4e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.098394 Jun 29 10:03:56.618120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 394/751] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:56 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:56.644550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:56.645197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:56.652186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.652632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:56.653163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9567dc4-acfe-4eda-b0a6-56cab292aef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068038 Jun 29 10:03:56.653417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:56.653761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 358/752] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 10:03:56.653895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:57.642873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:57.643505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:57.651582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:57.652037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:57.652812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:57.653271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:57.728875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:57.741710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d8a32ae-179a-48b9-8f9a-732ebefaa708 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.102521 Jun 29 10:03:57.742832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 359/753] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:57 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:03:57.750482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:57.751883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:57.762511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:57.763296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:57.764664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:57.765425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:57.796827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:03:57.804369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b57481b6-2562-443a-b34e-b939b0a55f26 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060037 Jun 29 10:03:57.804973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 360/754] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:58.769311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:58.770364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:58.780843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:58.781467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:58.782667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:58.783433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:58.870749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:58.882184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1dd38046-7c2f-4a4d-961e-cfe3c5bd8548 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.116868 Jun 29 10:03:58.882842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 361/755] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:58 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:03:58.888013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:58.888984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:58.896404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:58.896852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:58.897644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:58.898086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:58.931912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f51b41f-5afd-4ea8-b653-a1163d529f12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047928 Jun 29 10:03:58.932617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 362/756] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:03:59.900452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:03:59.901165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:03:59.914282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:59.914786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:59.915570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:03:59.916051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:03:59.984650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:03:59.994137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79edee28-26d6-482d-af98-4be8d021ce9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.098031 Jun 29 10:03:59.995022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 363/757] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:03:59 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:00.000219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:00.001176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:00.008705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:00.009154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:00.009935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:00.010368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:00.045950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4313de51-a9d6-41fb-9ae3-d2ef6d88ca5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049537 Jun 29 10:04:00.046813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 364/758] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:03:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:01.013414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:01.014200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:01.021953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:01.022544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:01.023458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:01.023981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:01.097981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:01.107866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ac9e1b86-6e33-4763-be38-20b27285f7b2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.098392 Jun 29 10:04:01.108544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 365/759] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:01 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:01.113752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:01.114987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:01.121997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:01.122662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:01.123587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:01.124067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:01.158906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-738e2b5d-c05b-4be2-8aa7-8cbec61edc87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049158 Jun 29 10:04:01.159707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 366/760] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:02.126957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:02.127842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:02.135275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:02.135707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:02.136534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:02.136989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:02.207254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:02.216750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a3d71eed-b0fe-4e79-a66c-0ba6ce033bf4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.093899 Jun 29 10:04:02.217511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 367/761] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:02 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:04:02.227512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:02.229174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:02.237552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:02.238054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:02.238931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:02.239437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:02.273951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1ad15d5a-9dee-42ca-99e0-c2c0ed9629d0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054964 Jun 29 10:04:02.274556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 368/762] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:03.246062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:03.246955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:03.257779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:03.258234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:03.259112 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:03.259545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:03.329949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:03.338688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3995299d-61c3-4758-8f31-9bf71af59faf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.099943 Jun 29 10:04:03.339300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 369/763] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:03 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:03.344751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:03.345867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:03.353837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:03.355134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:03.355134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:03.355750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:03.389784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-18f39845-e4c3-44f7-8005-89decf78f64e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049357 Jun 29 10:04:03.390341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 370/764] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:04.356923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:04.357629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:04.364938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:04.365410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:04.366201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:04.366652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:04.431580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:04.439609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-883b4f13-bbf5-417d-ba88-eb48d151681c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.086759 Jun 29 10:04:04.440235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 371/765] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:04 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:04.445657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:04.446984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:04.453605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:04.454046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:04.454861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:04.455290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:04.490294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8507976-c1f4-486b-a1cc-88d2dd3742cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048511 Jun 29 10:04:04.491149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 372/766] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:05.457598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:05.458721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:05.466131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:05.466613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:05.467548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:05.467985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:05.534691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:05.553345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c0e29c53-27fb-4386-9239-10abdb9907a8 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.094398 Jun 29 10:04:05.558845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 373/767] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:05 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:05.567017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:05.568013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:05.575243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:05.575700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:05.576499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:05.576940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:05.612599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-914c4ff5-783d-44dd-84de-481565b9d8eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052149 Jun 29 10:04:05.613177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 374/768] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:06.577507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:06.578088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:06.586286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:06.586768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:06.587538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:06.587974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:06.649816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=35 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:04:06.651514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:06.659882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-83df85b2-14ac-4230-b2f9-9f413f26764e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.087525 Jun 29 10:04:06.660544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 375/769] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:06 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:06.665325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:06.666239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:06.672465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:06.672907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:06.673668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:06.674090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:06.685686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:04:06.707083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f6c14c81-d382-454d-a7a6-b5e555377df5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045498 Jun 29 10:04:06.707673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 376/770] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:07.677285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:07.677958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:07.686919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:07.687441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:07.688481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:07.689083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:07.707001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:04:07.766235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:07.774237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a6ddc582-5f3f-4b0f-ba28-7ebafa73581b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.100962 Jun 29 10:04:07.774864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 377/771] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:07 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:07.779436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:07.780356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:07.786534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:07.787015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:07.787785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:07.788226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:07.818602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4651014-0ff9-4517-9d3d-a990168da537 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042687 Jun 29 10:04:07.819188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 378/772] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:08.497295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-772605098"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:04:08.497820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:08.504507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:08.504949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:08.505708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:08.506134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:08.646758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.network.security_group_api [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Removing security group d814962c-dac8-4d8f-930a-973866087bb7 from port 87511825-cede-4e5d-a0f9-cad98a2b6e4d Jun 29 10:04:09.079334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74365310-87a1-4dec-b56f-f4f42a139443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/action" status: 202 len: 0 microversion: 2.1 time: 0.586627 Jun 29 10:04:09.083806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 379/773] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:04:08 2022] POST /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:04:09.095758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:09.096370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:09.110541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:09.110716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:09.111530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:09.111960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:09.234142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:09.245605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51c2a3f0-5242-4166-8e55-3a59bbd80a72 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.160546 Jun 29 10:04:09.246358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 380/774] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:09 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:09.260385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:09.262134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:09.268412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:04:09.271145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:09.271912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:09.273159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:09.273917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:09.326514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02d6ac99-1f39-428e-a67f-c859a2be5334 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078761 Jun 29 10:04:09.331561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 381/775] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:09.417076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-c818bd60-acb0-4ee1-bc62-94d498181147 req-b92c1530-8260-4e7b-ab40-12ea5f172b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:04:09.425881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-c818bd60-acb0-4ee1-bc62-94d498181147 req-b92c1530-8260-4e7b-ab40-12ea5f172b25 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:09.426812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-c818bd60-acb0-4ee1-bc62-94d498181147 req-b92c1530-8260-4e7b-ab40-12ea5f172b25 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:09.440680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-c818bd60-acb0-4ee1-bc62-94d498181147 req-b92c1530-8260-4e7b-ab40-12ea5f172b25 service nova] Creating event network-changed:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:04:09.446723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-c818bd60-acb0-4ee1-bc62-94d498181147 req-b92c1530-8260-4e7b-ab40-12ea5f172b25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113354 Jun 29 10:04:09.447906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 382/776] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:04:10.266892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:10.267679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:10.276049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:10.276471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:10.277334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:10.277790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:10.356252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:04:10.367246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-18248b87-d257-45e9-930c-c45545a0638f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.104886 Jun 29 10:04:10.367246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 383/777] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:04:10 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:04:10.372095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:10.373059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:10.390472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:10.390994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:10.392074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:10.392675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:10.427006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7a2b04ce-65ef-4ea6-896c-3727f238491e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058672 Jun 29 10:04:10.427613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 384/778] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:04:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:04:10.432933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:04:10.433440 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:04:10.439907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:10.440354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:10.441139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:04:10.441817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:04:20.437525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=9 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:04:20.505414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=43 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:04:56.240813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:04:56.241566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:04:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:05:09.888163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:05:09.888786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f (ip 10.222.0.52) !!! Jun 29 10:05:17.778798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:05:17.779498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:05:36.608305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:05:36.610073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:05:36.611570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:05:36.612277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:36.613522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 409 to user: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:05:36.614505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6aeaab0c-7abf-488f-b9de-c20fae635de7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 409 len: 152 microversion: 2.1 time: 99.971251 Jun 29 10:05:36.614505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 395/779] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:03:56 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 152 bytes in 99972 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 29 10:05:36.651272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:05:36.728767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:36.729419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:36.736250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.736696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:36.737465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.737902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:36.809111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:36.817547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e6b02f1-2f21-4e52-a419-463cb5ff9a9d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.204565 Jun 29 10:05:36.818119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 396/780] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:36 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:36.822892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:36.823851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:36.829931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.830392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:36.831189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.831620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:36.862204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93b22d54-2b32-4f43-883f-10346f3d71d4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043033 Jun 29 10:05:36.862786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 397/781] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:36.867425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-b364476f-a9f3-43f6-b7cc-a65da2c82029 req-76cdacca-d368-4501-846f-3bace6cad774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:05:36.876206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b364476f-a9f3-43f6-b7cc-a65da2c82029 req-76cdacca-d368-4501-846f-3bace6cad774 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.876641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-b364476f-a9f3-43f6-b7cc-a65da2c82029 req-76cdacca-d368-4501-846f-3bace6cad774 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:36.888285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-b364476f-a9f3-43f6-b7cc-a65da2c82029 req-76cdacca-d368-4501-846f-3bace6cad774 service nova] Creating event network-changed:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:05:36.893527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-b364476f-a9f3-43f6-b7cc-a65da2c82029 req-76cdacca-d368-4501-846f-3bace6cad774 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029675 Jun 29 10:05:36.894170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 398/782] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:05:36.899925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:36.900504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:36.907763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.908217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:36.908970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:36.909396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:37.954512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04386c5f-5100-49cb-a526-029e5b592ff6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 202 len: 0 microversion: 2.1 time: 87.525599 Jun 29 10:05:37.955369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 385/783] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:04:10 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 0 bytes in 87527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:05:37.962913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:37.963658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:37.972093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:37.972868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:37.973955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:37.974771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.010972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:05:38.013274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:05:38.014689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:05:38.015629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued Jun 29 10:05:38.016797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:05:38.022826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 409 to user: Cannot 'detach_volume' instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 while it is in vm_state rescued {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:05:38.022826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b3da79b9-cf2b-4f31-9e23-68c9c8d92e3a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 409 len: 152 microversion: 2.1 time: 1.123939 Jun 29 10:05:38.022826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 399/784] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:05:36 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 152 bytes in 1125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 10:05:38.024841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:38.025475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:38.031577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.032054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.032829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.033262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.279313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:38.290708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-968b9bd4-60ec-4f21-bbd6-2dbc0c4084fd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.269981 Jun 29 10:05:38.291253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 400/785] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:38.295798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:38.296710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:38.302897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.303347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.304097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.304511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.336909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0f53232a-7bd7-46b1-953f-16d6fa155d58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044408 Jun 29 10:05:38.337423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 401/786] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:38.341961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:05:38.342493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:38.348337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.348796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.349548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.349993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.426542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70f6acb2-f221-4c68-bd9a-4ebc5e001278 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/action" status: 202 len: 0 microversion: 2.1 time: 0.087392 Jun 29 10:05:38.427416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 402/787] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:05:38 2022] POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:05:38.437228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:38.438015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:38.445537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.446141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.447163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:38.447617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:38.674357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:38.683760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5ab9b97a-af08-43b8-854f-efc4bd54a2bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1722 microversion: 2.1 time: 0.250566 Jun 29 10:05:38.684646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 403/788] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:39.309924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:39.310660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:39.317689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:39.318136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:39.318942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:39.319352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:39.390988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:39.401408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7c194f01-798e-47d8-a9a0-b71fef9c599e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.095417 Jun 29 10:05:39.401950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 404/789] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:39 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:39.406674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:39.407654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:39.414018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:39.414676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:39.415912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:39.416340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:39.446801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8bc85525-f61a-465d-bd90-2be6148a20ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043750 Jun 29 10:05:39.447354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 405/790] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:39.701326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:39.701934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:39.708967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:39.709422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:39.710232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:39.710764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:39.864888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:39.874416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-09deb412-9fa8-4b15-a577-7df92029e964 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1722 microversion: 2.1 time: 0.176986 Jun 29 10:05:39.875028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 406/791] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:05:40.418760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:40.419418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:40.426375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:40.426871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:40.427634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:40.428070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:40.500078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:40.512716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-66c7d095-688d-4415-8723-d7e3bdcb4567 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.098160 Jun 29 10:05:40.513481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 407/792] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:40 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:40.520182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:40.521523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:40.530496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:40.531112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:40.532163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:40.532768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:40.575232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6cc758bf-8cc8-43a6-a10c-21be0874bea3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060193 Jun 29 10:05:40.575952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 408/793] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:40.892472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:40.893091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:40.900438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:40.900885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:40.901647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:40.902076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:41.036234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:41.045946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d1e9dca7-e889-4c72-a6ad-1e23bfdb4709 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1722 microversion: 2.1 time: 0.157336 Jun 29 10:05:41.046518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 409/794] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:41.531612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:41.532356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:41.540416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:41.540895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:41.541670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:41.542101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:41.615176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:41.623575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-573c3ffd-957a-4f00-b15a-142e048cbb2c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.097082 Jun 29 10:05:41.624139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 410/795] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:41 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:41.628870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:41.629787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:41.635999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:41.636451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:41.637209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:41.637651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:41.662955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:05:41.667922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-81276feb-7f92-499a-b321-8a2be4332ca3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042690 Jun 29 10:05:41.668486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 411/796] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:42.066611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:42.067483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:42.076499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.076961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.077721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.078159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.216045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:42.224647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ec67e108-4e2a-4183-ab2e-41aac0362cfd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1728 microversion: 2.1 time: 0.163872 Jun 29 10:05:42.225292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 412/797] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:42.247841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:42.248338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:42.254544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.255024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.255800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.256238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.335464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8a5d920a-cc73-4c13-bfc6-853ec999c5dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091388 Jun 29 10:05:42.336105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 413/798] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:05:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:05:42.641308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:42.641950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:42.648182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.648776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.650232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.650772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.724784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:42.733099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-50c40d97-6d9d-43e9-af94-872ec8c21d4d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.096168 Jun 29 10:05:42.733758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 414/799] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:42 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:05:42.738548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:42.739512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:42.746342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.746860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.747647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:42.748101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:42.782737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-705de4dd-ea77-44b8-af87-0b413ec5a52f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047850 Jun 29 10:05:42.783297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 415/800] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:43.334180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-0a2529cf-4e01-4a23-9af5-e419c978b0d9 req-51aaba56-9122-4c1d-9672-eb72ea64f0aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:05:43.342595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-0a2529cf-4e01-4a23-9af5-e419c978b0d9 req-51aaba56-9122-4c1d-9672-eb72ea64f0aa service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:43.343042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-0a2529cf-4e01-4a23-9af5-e419c978b0d9 req-51aaba56-9122-4c1d-9672-eb72ea64f0aa service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:43.354183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-0a2529cf-4e01-4a23-9af5-e419c978b0d9 req-51aaba56-9122-4c1d-9672-eb72ea64f0aa service nova] Creating event network-changed:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:05:43.359293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-0a2529cf-4e01-4a23-9af5-e419c978b0d9 req-51aaba56-9122-4c1d-9672-eb72ea64f0aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088563 Jun 29 10:05:43.359896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 416/801] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:05:43.750744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:43.752310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:43.760373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:43.760833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:43.761638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:43.762073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:43.844682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:43.852765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f6db3f0-08ba-4fbe-9a22-59a008a351b7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.106917 Jun 29 10:05:43.862722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 417/802] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:43 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:43.862722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:43.862722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:43.865405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:43.865869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:43.866680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:43.868018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:43.898867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d97540a7-e066-4577-8140-164ffe5b9980 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044153 Jun 29 10:05:43.902694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 418/803] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:44.873326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:44.874060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:44.882006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:44.882810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:44.883659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:44.884552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:44.948425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:44.956278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dd559c53-0651-4c32-9682-ea37a964b315 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.089431 Jun 29 10:05:44.956844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 419/804] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:44 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:44.961709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:44.962682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:44.968711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:44.969155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:44.969912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:44.970348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:45.009525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19612aae-7fac-4fe1-81cb-822251b778db tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051203 Jun 29 10:05:45.010114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 420/805] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:45.375427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a7561c54-68a9-4a1c-93d8-19e69e7c63d8 req-6ebde3a8-6a0e-475c-92e8-60dd9cd2d967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:05:45.387838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a7561c54-68a9-4a1c-93d8-19e69e7c63d8 req-6ebde3a8-6a0e-475c-92e8-60dd9cd2d967 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:45.388343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a7561c54-68a9-4a1c-93d8-19e69e7c63d8 req-6ebde3a8-6a0e-475c-92e8-60dd9cd2d967 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:45.403062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a7561c54-68a9-4a1c-93d8-19e69e7c63d8 req-6ebde3a8-6a0e-475c-92e8-60dd9cd2d967 service nova] Creating event network-changed:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:05:45.408055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a7561c54-68a9-4a1c-93d8-19e69e7c63d8 req-6ebde3a8-6a0e-475c-92e8-60dd9cd2d967 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037902 Jun 29 10:05:45.408634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 421/806] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:05:45.974736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:45.975424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:45.982195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:45.982674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:45.983449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:45.983891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:46.049390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:46.057382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-25074794-3c83-4f8a-9d82-0837c5d4df2b tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.087508 Jun 29 10:05:46.057962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 422/807] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:45 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:46.062713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:46.063702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:46.069667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:46.070114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:46.070916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:46.071366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:46.101599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df63464e-c503-45cd-9885-2f93398077bb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042574 Jun 29 10:05:46.102146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 423/808] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:47.074880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:47.075545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:47.083001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:47.083451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:47.084236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:47.084668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:47.153670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:47.161489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb4617a3-4bae-443b-b432-e47dabe069e5 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.091763 Jun 29 10:05:47.162059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 424/809] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:47 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:47.169668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:47.169668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:47.175220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:47.175681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:47.176460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:47.176912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:47.210693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8bd92790-8965-4e8f-bb0d-9719ad2f6fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047426 Jun 29 10:05:47.211275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 425/810] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:47.969288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:05:48.002949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:05:48.182763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:48.183385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:48.191527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:48.192174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:48.193380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:48.193991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:48.272472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:48.283019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a8561fb6-f41f-46ec-922b-6d83501cfca4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.106051 Jun 29 10:05:48.283715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 426/811] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:48 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:48.288341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:48.289261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:48.297091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:48.297705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:48.298880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:48.299369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:48.330868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1522214e-d5dd-4faf-ab90-b52783f9901b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046073 Jun 29 10:05:48.331421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 427/812] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:49.300634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:49.301350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:49.308763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:49.309142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:49.309904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:49.310334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:49.383059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:49.391121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3d521385-c429-493a-b4a1-a6f7be7b88f6 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.094445 Jun 29 10:05:49.391695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 428/813] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:49 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:49.396641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:49.398804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:49.404924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:49.405373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:49.406135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:49.406590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:49.437466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-018c1f83-c175-4baa-a437-4edae73b40b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Jun 29 10:05:49.438153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 429/814] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:50.410687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:50.411349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:50.418409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:50.418896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:50.419682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:50.420397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:50.426608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:05:50.486684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:50.494995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d584fd08-1607-45eb-967c-87661a60f17e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.089563 Jun 29 10:05:50.495652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 430/815] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:50 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:50.500298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:50.501215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:50.507059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:50.507509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:50.508264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:50.508697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:50.538410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-62bc41d1-d2ab-481a-8662-ba3485a56edf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041707 Jun 29 10:05:50.538992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 431/816] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:51.515221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:51.515938 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:51.525559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:51.526151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:51.527212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:51.527779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:51.605312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:51.613441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4303f487-4c84-407f-be36-92e21bc358f7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.103277 Jun 29 10:05:51.614028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 432/817] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:51 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:51.618847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:51.619797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:51.625808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:51.626260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:51.627062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:51.627498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:51.657282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc2f768b-cb5b-4eb4-b6b2-b891614958bf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042197 Jun 29 10:05:51.657841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 433/818] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:52.631421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:52.632157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:52.639126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:52.639577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:52.640347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:52.640786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:52.723348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:52.731657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-516adf99-75bb-49c8-9119-44302cad9dbf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.104304 Jun 29 10:05:52.732227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 434/819] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:52 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:52.736767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:52.737680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:52.743770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:52.744216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:52.744969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:52.746004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:52.778692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-725e2731-705c-437b-a014-feb01f8935f5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045386 Jun 29 10:05:52.779272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 435/820] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:53.749803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:53.750504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:53.757238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:53.757705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:53.758492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:53.758974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:53.831565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:53.843530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9c9a891c-bcf9-4a64-a215-8c482171476f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.097469 Jun 29 10:05:53.844365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 436/821] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:53 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:53.850967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:53.852372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:53.860977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:53.861425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:53.862201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:53.862660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:53.899702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-99874882-5e0b-4102-86d0-4b2af107e5cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054087 Jun 29 10:05:53.900312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 437/822] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:54.866192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:54.866938 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:54.874726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:54.875183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:54.875952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:54.876411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:54.953249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:54.963450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0eb601db-3362-4dcc-8ad8-eed4fda42ae0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.101528 Jun 29 10:05:54.964362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 438/823] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:54 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:54.970864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:54.971775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:54.977861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:54.978293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:54.979094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:54.979523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:55.009206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a56cc16c-3958-4333-803c-fe12d9834462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043705 Jun 29 10:05:55.009753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 439/824] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:55.984108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:55.984818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:55.991713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:55.992162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:55.992920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:55.993351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:56.057132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:56.065656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7b1edcff-b368-414a-aaf4-70b86ab0072e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.086041 Jun 29 10:05:56.066238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 440/825] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:55 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:56.070907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:56.071981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:56.078209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:56.078695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:56.079478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:56.079904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:56.119979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dca2a41a-8b8e-486b-b6d4-f1675921daea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052588 Jun 29 10:05:56.120520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 441/826] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:57.084543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:57.085199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:57.092208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:57.092813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:57.093635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:57.094070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:57.168647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:57.180791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93570f84-4140-4c36-b40a-e94d4fba319d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.100346 Jun 29 10:05:57.181526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 442/827] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:57 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:57.188141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:57.189071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:57.195244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:57.195700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:57.196479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:57.196913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:57.228290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-750a23f5-d970-42ea-9da1-ac67d97c3af6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045539 Jun 29 10:05:57.228856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 443/828] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:58.202369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:58.203164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:58.210420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:58.210889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:58.211694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:58.212133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:58.536310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:58.544304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ac2fa0ec-5906-4943-8a65-bb08f39b19bf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.347643 Jun 29 10:05:58.544880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 444/829] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:58 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:05:58.549578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:58.550502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:58.553408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:05:58.556901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:58.557343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:58.558105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:58.558521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:58.590328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b6aa8ce3-028c-481b-a9fa-4d7ef44846fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044350 Jun 29 10:05:58.590930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 445/830] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:05:59.563284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:59.564244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:59.574187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:59.574871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:59.575766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:59.576220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:59.650075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:05:59.653525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:05:59.658337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-794f3f97-ad5b-48f0-b5dc-fb13b1f09ab2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.100304 Jun 29 10:05:59.658968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 446/831] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:05:59 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:05:59.663603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:05:59.664540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:05:59.671275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:59.671799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:59.672586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:05:59.673027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:05:59.702095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c3dbd15f-0e20-4207-9bf9-2c8ffc4b8152 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 Jun 29 10:05:59.702699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 447/832] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:05:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:00.676742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:00.677467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:00.687096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:00.687624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:00.688494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:00.688929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:00.758509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:00.766536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9af8e7b3-2133-48f5-bc4f-796f7c34cdf1 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.094662 Jun 29 10:06:00.767158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 448/833] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:00 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:06:00.771897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:00.772849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:00.779217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:00.779676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:00.780490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:00.780934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:00.810858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b407c801-17b1-4a87-9a7a-ed7a576f347e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042597 Jun 29 10:06:00.811423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 449/834] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:01.786476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:01.787387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:01.795953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:01.796582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:01.797708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:01.798337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:01.863988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:01.872615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6be1a15a-4fda-4c26-98ca-ff533eef610d tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.091236 Jun 29 10:06:01.872925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 450/835] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:01 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:01.877995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:01.878965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:01.886268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:01.886777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:01.887537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:01.888009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:01.919414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9ed944b-fe2c-4bcb-b97e-234af22f4cd5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045359 Jun 29 10:06:01.920071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 451/836] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:02.891695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:02.892363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:02.902114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:02.902883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:02.903682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:02.904111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:02.975015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:02.983035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94e86d7d-74be-4234-828a-17ad53404305 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.095267 Jun 29 10:06:02.983605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 452/837] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:02 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:02.989364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:02.990272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:02.996813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:02.997291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:02.998029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:02.998485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:03.030432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-71105087-6c37-4b5a-aed9-c582c114bf8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045632 Jun 29 10:06:03.031060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 453/838] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:04.000970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:04.001701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:04.009350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:04.009806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:04.010593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:04.011075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:04.079302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:04.087867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ee79a0bc-2efa-446f-88de-b6cb86e08d0f tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.090813 Jun 29 10:06:04.088406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 454/839] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:03 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:04.093242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:04.094166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:04.100579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:04.101029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:04.101798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:04.102228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:04.131999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5c8d2d1c-c38d-44b7-8e18-c7075b150291 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042457 Jun 29 10:06:04.132552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 455/840] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:05.105450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:05.106110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:05.113146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:05.114099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:05.114962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:05.115375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:05.180209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:05.188779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b2e7bf91-c6e5-4ab5-8e12-9ad466e0fd49 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.087296 Jun 29 10:06:05.189357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 456/841] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:05 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:05.194171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:05.195126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:05.202880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:05.203492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:05.204588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:05.205135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:05.237159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cae1d83a-52eb-48c5-9280-e21144c29462 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046756 Jun 29 10:06:05.237739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 457/842] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:06.207347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:06.208048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:06.215142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:06.215588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:06.216350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:06.216785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:06.282711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:06.292293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e75f014-ba99-4d81-9583-08738bed8da7 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.089165 Jun 29 10:06:06.292836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 458/843] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:06 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:06.297487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:06.298406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:06.304905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:06.305350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:06.306101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:06.306597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:06.336739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75c17ae3-e000-41f7-b360-2d7359cdf1a2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042826 Jun 29 10:06:06.337330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 459/844] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:07.312407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:07.313003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:07.322309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:07.322975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:07.324117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:07.324679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:07.393269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:07.402817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d07ec73b-1f21-488b-a1a5-6d2cee9165bb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.096663 Jun 29 10:06:07.403399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 460/845] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:07 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:06:07.408185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:07.409109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:07.415718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:07.416199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:07.416956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:07.417428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:07.448379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-30a3fe20-9f05-48af-9be8-d2da78f9c4cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043857 Jun 29 10:06:07.448987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 461/846] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:08.420281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:08.420959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:08.428609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:08.429535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:08.430307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:08.430787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:08.495611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:08.503613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-253c244a-a2cd-4afa-8cd6-3623e41859fb tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.087401 Jun 29 10:06:08.504187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 462/847] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:08 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:08.509051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:08.509979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:08.516723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:08.517166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:08.517936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:08.518375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:08.536610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:06:08.549222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d2679385-4c89-4c51-9011-b5e4a9d63efc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044042 Jun 29 10:06:08.549807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 463/848] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:09.522414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:09.523707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:09.530236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:09.530724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:09.531531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:09.531976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:09.600722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:06:09.608833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-057c10d8-0564-403b-8b44-11a458daf4d4 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.091118 Jun 29 10:06:09.609406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 464/849] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:06:09 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:06:09.614022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:09.614965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:09.621595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:09.621974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:09.622780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:09.623234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:09.653087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8185c839-ef77-4a0d-93f3-b39709b861a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042624 Jun 29 10:06:09.653663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 465/850] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:06:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:06:10.651311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:06:10.651961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:06:10.660794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:10.661344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:10.662520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:06:10.663304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:06:20.656593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=42 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:06:20.692887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=18 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:07:00.255698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:07:00.256592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:07:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:07:36.806104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:07:36.958627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:07:38.182019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:07:38.184864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:07:38.186336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:07:38.187761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:07:38.189605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.191056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:07:38.193080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) Jun 29 10:07:38.194543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.196235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d229c89-47d7-470c-bbb7-138ea8951f21) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:07:38.196235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92ce6a72-f7f7-452e-a999-3b4cf96c327e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 120.229680 Jun 29 10:07:38.196235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 386/851] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:05:37 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 120231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:07:38.196235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:07:38.196638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:07:38.200326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.200776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.201549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.201983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.220654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:07:38.223090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:07:38.224378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:07:38.225235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:07:38.226258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.227430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:07:38.228528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) Jun 29 10:07:38.229604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:07:38.232932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-427d45e0-853c-4e35-ab39-c5cc9f5393e7) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:07:38.232932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d67f451e-7c36-4589-bb09-82cd1863f591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 87.686814 Jun 29 10:07:38.232932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 466/852] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:06:10 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 87688 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 29 10:07:38.234363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:07:38.247274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:07:38.256134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.256963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.257719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.258148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.271186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:07:38.287625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb3e8c29-a1f1-4274-a6a7-eee3cc14b54e tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.093168 Jun 29 10:07:38.287625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 387/853] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:07:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:07:38.287625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:07:38.287625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:07:38.291878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b16a50c0-4f48-4444-913c-764868f6cfda tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065459 Jun 29 10:07:38.292629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 467/854] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:07:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:07:38.294253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.294735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.295504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.295948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.298726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:07:38.299335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:07:38.305600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.306051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.306836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.307268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.370605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:07:38.378875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e43dfbe-a8bd-456d-9368-7349ffc550bd tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.084955 Jun 29 10:07:38.379404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 468/855] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:07:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:07:38.383970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:07:38.384915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:07:38.391063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.391503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.392264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.392695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.422515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fd181142-ec40-4a09-be06-9ea8f654e8d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042069 Jun 29 10:07:38.423098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 469/856] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:07:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:07:38.427699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:07:38.428186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:07:38.434029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.434473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:38.435258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:07:38.435694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:07:48.291246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:07:48.318670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=14 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:07:48.431971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=8 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:07:48.454855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:08:16.250043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:08:16.250874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:08:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:08:29.898861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:08:29.899517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f (ip 10.222.0.52) !!! Jun 29 10:08:37.789514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:08:37.790163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:09:03.709954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:09:03.710663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f (ip 10.222.0.52) !!! Jun 29 10:09:37.231010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:09:37.385025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:09:38.360027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:09:38.362473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:09:38.364383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:09:38.365340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:09:38.366678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:09:38.368665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:09:38.370069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) Jun 29 10:09:38.371540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:09:38.373456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d570193-b11c-47c3-bf42-51e9962ab477) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:09:38.373456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d458517-f923-427c-95b2-bf187748fed3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 120.081348 Jun 29 10:09:38.373456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 388/857] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:07:38 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 120082 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:09:38.373456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:09:38.373893 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:09:38.381592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.382338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.383032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.383470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.426776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fba42657-b3af-4bba-b961-c485fd7e5a7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 202 len: 0 microversion: 2.1 time: 120.002385 Jun 29 10:09:38.428255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 470/858] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:07:38 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 0 bytes in 120004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:09:38.437607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:09:38.439184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:09:38.448274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.449016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.449867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.450293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.458497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:09:38.466910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-258f84d1-a860-485e-9360-a4d1b91082e2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.101237 Jun 29 10:09:38.467540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 389/859] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:09:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:09:38.472993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:09:38.473523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:09:38.480102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.480558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.481341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.481778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.486151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5b423ada-50d6-418f-9f5b-0397971cc91f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056375 Jun 29 10:09:38.486749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 471/860] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:09:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:09:38.492537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:09:38.493034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:09:38.499024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.499468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:38.500230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:09:38.500673 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:09:48.477716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:09:48.498978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:09:48.502647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=14 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:09:48.521980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:10:20.265074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:10:20.266199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:10:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f (ip 10.222.0.52) !!! Jun 29 10:11:06.738437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:11:06.739133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:11:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:11:36.260264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:11:36.261353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:11:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:11:37.812132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:11:37.861165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:11:38.524693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:11:38.527163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:11:38.528592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:11:38.529462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:11:38.530675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.531880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:11:38.533212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) Jun 29 10:11:38.534351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.536739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-77a42d92-bce5-47b3-befe-37a1e2fe3390) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:11:38.536739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-145882bf-97b2-48c4-b35a-47d3c5288318 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 120.059950 Jun 29 10:11:38.536739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 390/861] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:09:38 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 120061 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:11:38.562418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:11:38.565186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:11:38.567290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:11:38.567908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:11:38.568909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.570490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:11:38.571561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) Jun 29 10:11:38.572644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:11:38.573663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0dac3c69-2dab-455d-bbe3-32d70b0a60cb) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:11:38.573663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-828b5eae-303b-41cc-88ee-833c1269f5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 400 len: 269 microversion: 2.1 time: 120.078968 Jun 29 10:11:38.573663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 472/862] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:09:38 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 269 bytes in 120081 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:11:38.573663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:11:38.575530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:11:38.584598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.585058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.585860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.586278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.618705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5b7c4c38-6e0f-43fc-8d21-3ae1fc4155fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049601 Jun 29 10:11:38.619296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 473/863] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:11:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:11:38.624351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:11:38.624844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:11:38.632096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.632556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.633342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.633784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.655122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:11:38.655813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:11:38.663093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.663637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.664414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.665233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.728418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:11:38.736641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6abfc3dc-666e-42f5-b979-6de3cf6c74af tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.205843 Jun 29 10:11:38.737217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 391/864] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:11:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:11:38.741909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:11:38.742401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:11:38.748554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.749013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:38.749773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:11:38.750211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:11:48.630329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:11:48.655551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=14 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:11:48.746408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:11:48.769268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=14 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:11:49.907686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:11:49.908358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:11:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:11:57.798671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:11:57.799275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f (ip 10.222.0.52) !!! Jun 29 10:12:23.719215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:12:23.719947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 (ip 10.222.0.52) !!! Jun 29 10:13:37.939212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:37.985814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:38.027802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:38.030069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:38.033106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.034551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.036284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.038107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.039529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) Jun 29 10:13:38.040930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.042986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-55bca170-4975-4bac-900e-be8373888fcf) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:38.042986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-478112ce-9e6e-4770-9366-5c7c06b8cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 119.411416 Jun 29 10:13:38.042986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 474/865] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:11:38 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 119413 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:38.068677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:38.071103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:38.072856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.073608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.074691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.076340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.077578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) Jun 29 10:13:38.078904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.080174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4414ce6a-3790-4b92-9219-d93249c8f11a) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:38.080174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40b626ac-b5f5-4d34-b235-35cc93b860e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 400 len: 269 microversion: 2.1 time: 119.334369 Jun 29 10:13:38.080174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 392/866] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:11:38 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 269 bytes in 119335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:38.080174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.080532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.086888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.087343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.088324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.088768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.115864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:13:38.210667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b584430a-c3d9-44a6-95da-df70a626da02 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 204 len: 0 microversion: 2.1 time: 0.136195 Jun 29 10:13:38.211642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 393/867] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:13:38 2022] DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:13:38.217553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.218267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.224845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.225627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.226219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.226704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.297562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:38.305815 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7356191a-158f-4bb0-9a01-26da6e4b53dc tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1225 microversion: 2.1 time: 0.092823 Jun 29 10:13:38.307317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 394/868] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:38.313245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.314412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.319862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.320438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.322212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.322766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.323631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.324160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.333229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.334082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.334900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.335639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.357953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1bf3013f-0b43-4fe8-8e5d-6c58123e65da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048621 Jun 29 10:13:38.358527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 395/869] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:13:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:13:38.363527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.364109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.371040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.371554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.372329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.372762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.427519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'services' on Instance uuid e79b46e7-cd1e-460d-a080-132fa6764043 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:38.471322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:38.525521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ea7cc8bf-9680-4def-b43e-c3f0e6bdfb35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a" status: 202 len: 0 microversion: 2.1 time: 0.490332 Jun 29 10:13:38.526117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 475/870] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:38 2022] DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:13:38.531409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.531998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.539285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.540130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.541129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.541580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.559614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:38.562000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:38.563477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.564099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.565144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.567710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.570962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) Jun 29 10:13:38.574341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.576747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cb44077-1144-4050-91ae-89b7dc6b6330) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:38.576747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f06ad6e-ef39-4208-8810-fdfe358f59cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 0.203985 Jun 29 10:13:38.576747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 396/871] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:38 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:38.576747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.577392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.581931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.582442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.583250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.583681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.721230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:38.787383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'services' on Instance uuid e79b46e7-cd1e-460d-a080-132fa6764043 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:38.874212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:38.876619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:38.878015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.878921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.879955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.885461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) Jun 29 10:13:38.886788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.888000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a59e3e5-86b1-4280-a7d5-c38e86370608) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:38.888000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3fd98505-8463-4002-811d-a51a51c937c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 400 len: 269 microversion: 2.1 time: 0.351484 Jun 29 10:13:38.888000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 476/872] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:38 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 269 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:38.888000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.888347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.892553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.893036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.893800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.894238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.913677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Request method failure captured: Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a HTTP/1.1 Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCMMfbt4R6J4iaRBPLUQ2B1GmxIcvzHC-37Hv4VZiU756yoCgqTIkRMeu3EvdEN-gZUpjDwOkVLIpXmuLC_Nvv-RNjLlXRdnGUrGRohlXdIeiZ9eBC79mk_UinHdj6TodBL6WdLSWm9W9lmwx6O31qRv832BSmFsWHOVFqWfisG3ayo Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:38.917254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 43964a0e6b48487bb90c5356d312b60d Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:38.918886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': 'e79b46e7-cd1e-460d-a080-132fa6764043', 'id': '965a1dfc-838b-4042-a138-287d0f25013a'} Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.919628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:38.921109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.922606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) Jun 29 10:13:38.925305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:38.927624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-02341493-7e83-41b0-b5cc-7f9c1ae2e2e0) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:38.927624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ca982bd-6302-44a6-ad85-7da6b06946e8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a" status: 400 len: 269 microversion: 2.1 time: 0.353731 Jun 29 10:13:38.927624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 397/873] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:38 2022] DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a => generated 269 bytes in 355 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:38.927959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:13:38.930827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.931453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:38.947700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.948141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.948959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.949474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.985776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:38.986356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.compute.api [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Instance is already in deleting state, ignoring this request Jun 29 10:13:38.986865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:38.986865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lazy-loading 'fault' on Instance uuid 1bac0f78-62e4-4cd7-a3c4-5db0831d274b {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:38.987406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-61c3685d-c6c4-40b2-881a-0df369ba003d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 204 len: 0 microversion: 2.1 time: 0.106975 Jun 29 10:13:38.987761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 477/874] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:13:38 2022] DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:13:38.993075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:38.994122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.000087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.000539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.001744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.002052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.033259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ff681e601f4892abffe5862def0547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0192e4102b644993a9482674674b1ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:39.037872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c3fe4fd4-b547-4ad4-a2c6-20f42f28f3b0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048945 Jun 29 10:13:39.038743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 478/875] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:13:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:13:39.041773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5807148-095b-4a95-afdc-fcd00510cbdf tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 200 len: 1230 microversion: 2.1 time: 0.120370 Jun 29 10:13:39.042475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 398/876] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:38 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:39.047294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.047722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.047847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.048229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.055360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.055567 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.055823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.055984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.056586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.056702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.057018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.057135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.146699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:39.206554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:39.246626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:39.249117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:39.250798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.251484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.252872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.254383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.255689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) Jun 29 10:13:39.256981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.258259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0813eed-98f2-442e-a6e4-65240974bd2c) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.258259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-16186cfe-4c3f-4a27-ac02-564f051b4405 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 0.211671 Jun 29 10:13:39.258259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 479/877] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:39.262507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.263860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.283266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.283936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.286283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.286920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.307127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:39.311504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:39.313909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.315085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.316957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.319408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.320664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) Jun 29 10:13:39.321899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.327525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-662f6434-a0da-43ab-a909-e739e92161fb) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.327525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5a2828a-1053-4140-b349-c9903354ed29 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 400 len: 269 microversion: 2.1 time: 0.282624 Jun 29 10:13:39.327525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 399/878] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 269 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:39.334031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.336255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.343145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.343965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.345064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.345679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.378590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:13:39.405117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'services' on Instance uuid e79b46e7-cd1e-460d-a080-132fa6764043 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:39.434302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.compute.api [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Instance is already in deleting state, ignoring this request Jun 29 10:13:39.435952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8fb9fa81-050b-4c89-ba9c-4a15d2d559f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 204 len: 0 microversion: 2.1 time: 0.106133 Jun 29 10:13:39.436131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 400/879] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:13:39.440698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.441300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.456666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.457575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.459155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.459765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.480156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] HTTP exception thrown: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Request method failure captured: Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b HTTP/1.1 Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCKR9dmMX4ZfnljRVtNizUx2dx31Fxgie544MHL0sCUIYThwNIFBoR8Bb8JljSmr2jPsUOcsyvpWnEfrli4fM6LIU-mPLGkaBYhK2kPY3vPTfQBdvlYQr92dPgDHq379agNyXQLdxYP6iQ1cOwG3ZFlhDzFn97zTHum-pb47SUkRA8I Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:39.481773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0192e4102b644993a9482674674b1ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0192e4102b644993a9482674674b1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 48ff681e601f4892abffe5862def0547 Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.483149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '1bac0f78-62e4-4cd7-a3c4-5db0831d274b'} Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.484128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.485370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.486549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Returning 404 to user: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.486549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a24f1316-38cd-44f2-8d9c-025d112403e0 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 404 len: 111 microversion: 2.1 time: 0.046165 Jun 29 10:13:39.487492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.487608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 401/880] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:39 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Request method failure captured: Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a HTTP/1.1 Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCMMfbt4R6J4iaRBPLUQ2B1GmxIcvzHC-37Hv4VZiU756yoCgqTIkRMeu3EvdEN-gZUpjDwOkVLIpXmuLC_Nvv-RNjLlXRdnGUrGRohlXdIeiZ9eBC79mk_UinHdj6TodBL6WdLSWm9W9lmwx6O31qRv832BSmFsWHOVFqWfisG3ayo Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:39.488600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 43964a0e6b48487bb90c5356d312b60d Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:39.490422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': 'e79b46e7-cd1e-460d-a080-132fa6764043', 'id': '965a1dfc-838b-4042-a138-287d0f25013a'} Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.491203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.492596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.495777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.497262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) Jun 29 10:13:39.499943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.501244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1926a93e-9b5c-4e14-bd52-3fc07d756874) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.501244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7efb5e3f-336e-48c9-8dd0-21dcc094168f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a" status: 400 len: 269 microversion: 2.1 time: 0.240209 Jun 29 10:13:39.501438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.501438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.501628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 480/881] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a => generated 269 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:39.503676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.504606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.504968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.505354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.505903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.506985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.515910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.516180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.517302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.517560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.542163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-32d66b8d-a760-4308-8a2d-02745475b45d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051898 Jun 29 10:13:39.542470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 402/882] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:13:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:13:39.547946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.548936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.555728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.556197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.557327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.557854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.613046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:39.671091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:39.699668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:39.702387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:39.703866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.705225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.706264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.710003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) Jun 29 10:13:39.711369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.712735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-335d31d9-70ff-4307-aaec-7662c643552a) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.712735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-825a26fb-7ab1-430c-972c-59f86b5634f9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 0.206229 Jun 29 10:13:39.712735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 481/883] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:39.712735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.713099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.721100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.722254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.723093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.723875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.746039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:39.748472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:39.749796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.750431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.751471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.752591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.753586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) Jun 29 10:13:39.754790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.756115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d31f2e1a-4ab4-4d6d-b350-a54f185e614e) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.756115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c54dac27-d1aa-4d68-b510-6a7e1bdcbd74 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 400 len: 269 microversion: 2.1 time: 0.206139 Jun 29 10:13:39.756115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 403/884] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 269 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:39.756115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.757166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.764440 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.764889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.765899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.766334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.794511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:13:39.797989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:39.853601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'services' on Instance uuid e79b46e7-cd1e-460d-a080-132fa6764043 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:39.854380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.compute.api [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Instance is already in deleting state, ignoring this request Jun 29 10:13:39.855260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-364513bd-0b9d-4b7c-8e4d-7f539f813d7e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 204 len: 0 microversion: 2.1 time: 0.103753 Jun 29 10:13:39.855830 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 404/885] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:13:39.860892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.861737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.869475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.869919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.870882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.871302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.888037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] HTTP exception thrown: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Request method failure captured: Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b HTTP/1.1 Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCKR9dmMX4ZfnljRVtNizUx2dx31Fxgie544MHL0sCUIYThwNIFBoR8Bb8JljSmr2jPsUOcsyvpWnEfrli4fM6LIU-mPLGkaBYhK2kPY3vPTfQBdvlYQr92dPgDHq379agNyXQLdxYP6iQ1cOwG3ZFlhDzFn97zTHum-pb47SUkRA8I Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:39.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0192e4102b644993a9482674674b1ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0192e4102b644993a9482674674b1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 48ff681e601f4892abffe5862def0547 Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.891467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '1bac0f78-62e4-4cd7-a3c4-5db0831d274b'} Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.892356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:39.893806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.896813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Returning 404 to user: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.898191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b731b285-398b-41b7-af04-a6201eda7f7c tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 404 len: 111 microversion: 2.1 time: 0.041298 Jun 29 10:13:39.898943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 405/886] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:39 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:13:39.904371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.905667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.912254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.913302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.914117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.914547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.921559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Request method failure captured: Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a HTTP/1.1 Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCMMfbt4R6J4iaRBPLUQ2B1GmxIcvzHC-37Hv4VZiU756yoCgqTIkRMeu3EvdEN-gZUpjDwOkVLIpXmuLC_Nvv-RNjLlXRdnGUrGRohlXdIeiZ9eBC79mk_UinHdj6TodBL6WdLSWm9W9lmwx6O31qRv832BSmFsWHOVFqWfisG3ayo Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:39.924254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 43964a0e6b48487bb90c5356d312b60d Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:39.925614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': 'e79b46e7-cd1e-460d-a080-132fa6764043', 'id': '965a1dfc-838b-4042-a138-287d0f25013a'} Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.926286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:39.927478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.929214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.930999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) Jun 29 10:13:39.932712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:39.933990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bb6fd813-c8fc-45a5-a141-fd6b0e05ed16) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:39.933990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c78550e5-6490-47e5-a1f9-386a1cef978a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a" status: 400 len: 269 microversion: 2.1 time: 0.220186 Jun 29 10:13:39.933990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 482/887] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a => generated 269 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:39.935513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.938230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.946743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4da4e661-c589-4b9d-82fc-89ef70175015 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046463 Jun 29 10:13:39.947284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 406/888] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:13:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:13:39.948805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.949377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.950689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.951233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.952275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:39.952870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:39.960466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.960914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:39.961694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:39.962113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.039498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:40.105378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lazy-loading 'services' on Instance uuid 17a2e166-d693-45f2-bc7f-16c59da0aa02 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:40.141975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:40.144832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:40.146888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.148095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.150729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.152211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.153688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) Jun 29 10:13:40.155136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.157821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23422422-0a0c-4e64-aadf-be522521d9d1) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:40.157821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-805a5952-bb78-47c8-9134-e96d91651b91 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 0.218821 Jun 29 10:13:40.157821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 483/889] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:40.162448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.162448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.166861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.167320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.168141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.168696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.204835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f HTTP/1.1 Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:40.207726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:13:40.209414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '17a2e166-d693-45f2-bc7f-16c59da0aa02', 'id': '146ce2d2-16b1-4574-8c89-a119f261a01f'} Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.210837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.212033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.213357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.214545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) Jun 29 10:13:40.219250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.220816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3dc9ef76-bbff-4101-8967-175f73a926aa) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:40.221268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc135881-5013-4399-b688-694c17bae4de tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f" status: 400 len: 269 microversion: 2.1 time: 0.269587 Jun 29 10:13:40.222001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 407/890] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:39 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments/146ce2d2-16b1-4574-8c89-a119f261a01f => generated 269 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:40.228397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.228904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.237096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.237096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.237579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.238133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.268219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:13:40.275145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:13:40.275350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:13:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a (ip 10.222.0.52) !!! Jun 29 10:13:40.290858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'services' on Instance uuid e79b46e7-cd1e-460d-a080-132fa6764043 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:40.326044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.compute.api [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Instance is already in deleting state, ignoring this request Jun 29 10:13:40.326938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8208d9a7-c5c3-4ef2-adb5-8560aac72226 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 204 len: 0 microversion: 2.1 time: 0.103643 Jun 29 10:13:40.327505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 408/891] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:13:40 2022] DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:13:40.332519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.333127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.341179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.343326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.343992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.344699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.356508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Request method failure captured: Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a HTTP/1.1 Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCMMfbt4R6J4iaRBPLUQ2B1GmxIcvzHC-37Hv4VZiU756yoCgqTIkRMeu3EvdEN-gZUpjDwOkVLIpXmuLC_Nvv-RNjLlXRdnGUrGRohlXdIeiZ9eBC79mk_UinHdj6TodBL6WdLSWm9W9lmwx6O31qRv832BSmFsWHOVFqWfisG3ayo Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:40.358725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 43964a0e6b48487bb90c5356d312b60d Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:13:40.360285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'server_id': 'e79b46e7-cd1e-460d-a080-132fa6764043', 'id': '965a1dfc-838b-4042-a138-287d0f25013a'} Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.361019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.362236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.363660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.366261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) Jun 29 10:13:40.367681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.368975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f471dbf1-bc3c-4911-a7d1-3135657f8d77) {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:40.368975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-50b4a337-89e6-4f32-b56d-221aa3478125 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a" status: 400 len: 269 microversion: 2.1 time: 0.211942 Jun 29 10:13:40.368975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 484/892] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:40 2022] DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043/os-volume_attachments/965a1dfc-838b-4042-a138-287d0f25013a => generated 269 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:40.369825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] HTTP exception thrown: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:40.370607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.371543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Request method failure captured: Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b HTTP/1.1 Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCKR9dmMX4ZfnljRVtNizUx2dx31Fxgie544MHL0sCUIYThwNIFBoR8Bb8JljSmr2jPsUOcsyvpWnEfrli4fM6LIU-mPLGkaBYhK2kPY3vPTfQBdvlYQr92dPgDHq379agNyXQLdxYP6iQ1cOwG3ZFlhDzFn97zTHum-pb47SUkRA8I Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:40.371926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0192e4102b644993a9482674674b1ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0192e4102b644993a9482674674b1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 48ff681e601f4892abffe5862def0547 Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:40.373690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '1bac0f78-62e4-4cd7-a3c4-5db0831d274b'} Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:40.375152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:40.376608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.378134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Returning 404 to user: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:40.378232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3fca15be-ab08-45ff-8abe-497c45133bc2 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 404 len: 111 microversion: 2.1 time: 0.047227 Jun 29 10:13:40.384488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 409/893] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:40 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:13:40.389145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.390005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.391248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.391833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.394772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.395409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.403641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.404244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.405200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.405776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.443019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3e87155-3c8e-4485-8e0e-394e7211f263 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076249 Jun 29 10:13:40.448382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 485/894] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 10:13:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:13:40.460081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.461438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.474900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.488984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.489860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.490345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.528566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:40.564300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-abe57b77-c74a-48f0-a163-5475a396cd00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114751 Jun 29 10:13:40.565255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 486/895] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:40.571661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:40.572692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:40.585921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lazy-loading 'services' on Instance uuid 1ab146cd-3f99-4717-94ea-5dd164c1f887 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:13:40.587762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.588228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.589028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.589499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.666699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Request method failure captured: Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 HTTP/1.1 Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCLR9krtQRNrDxihWzT2xuScT_3Zv39dXTxvmFlj-4TpEGYPmPOV6w9jOCtwkR6QPbFyrqLK7c9mi6BPrY_oc64VIxLys2LRIaxF2hqtUYkDc386gcVTJjdFcETNGdHr82MKaAM3vnVEL9Y7-pPQedggICL28JSI9JTyAnN8-nGIl-c Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:40.669088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ce73b243663d4ee6b991c9262d1286d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: ce73b243663d4ee6b991c9262d1286d5 Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766605503 Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: f2ed196e5ad6415aa9b7a7c1b3dad277 Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestMinimumBasicScenario-1766605503-project Jun 29 10:13:40.670684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'server_id': '1ab146cd-3f99-4717-94ea-5dd164c1f887', 'id': '1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36'} Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.671421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:40.672637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.673967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.675204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) Jun 29 10:13:40.676565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:40.678033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a8717fe1-f6f4-40fd-bca0-48a95c572f71) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:40.678033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6bf0369b-9658-4d3f-ae9a-2e057015988b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36" status: 400 len: 269 microversion: 2.1 time: 0.287250 Jun 29 10:13:40.678033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 410/896] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:13:40 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887/os-volume_attachments/1f7360b8-8b9d-4cdd-b9ab-37aa338b5b36 => generated 269 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:40.681925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-303601940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-698110575", "security_groups": [{"name": "tempest-secgroup-smoke-1483186916"}], "block_device_mapping_v2": [{"uuid": "68f08d03-e9ee-40e8-85e0-7582bbe747ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4eae6fbf-3414-4d08-88dd-e97fd883b29c"}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:40.713897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:40.723217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5dc396ea-bc03-4bbe-8285-ee39d769ee8b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 200 len: 1327 microversion: 2.1 time: 0.156638 Jun 29 10:13:40.734382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 487/897] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:40 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:40.806282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-3afb3709-f143-4dfd-9d32-1155632dd12d req-d2a18145-92c7-4673-93f0-b412a315c76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76483279-456b-4e8e-ad98-55f107a9d8f5", "name": "network-vif-deleted", "tag": "858910de-3c31-4e84-999b-060a7ff2278b"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:40.846489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-3afb3709-f143-4dfd-9d32-1155632dd12d req-d2a18145-92c7-4673-93f0-b412a315c76d service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:40.847874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-3afb3709-f143-4dfd-9d32-1155632dd12d req-d2a18145-92c7-4673-93f0-b412a315c76d service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:40.863312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-3afb3709-f143-4dfd-9d32-1155632dd12d req-d2a18145-92c7-4673-93f0-b412a315c76d service nova] Creating event network-vif-deleted:858910de-3c31-4e84-999b-060a7ff2278b for instance 76483279-456b-4e8e-ad98-55f107a9d8f5 on hv-cinder-76810 Jun 29 10:13:40.872603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-3afb3709-f143-4dfd-9d32-1155632dd12d req-d2a18145-92c7-4673-93f0-b412a315c76d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135145 Jun 29 10:13:40.873511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 488/898] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:40.889649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] validate_networks() for [('4eae6fbf-3414-4d08-88dd-e97fd883b29c', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:13:41.450718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:13:41.451804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:13:41.452600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:13:41.453185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:13:41.453930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:13:41.463443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:41.464599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:41.464713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.465143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.465928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.466407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.471520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.471972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.472800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.473270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.487219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Getting quotas for project 0192e4102b644993a9482674674b1ad7. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:13:41.493764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Getting quotas for user 48ff681e601f4892abffe5862def0547 and project 0192e4102b644993a9482674674b1ad7. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:13:41.557733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d60de042-10c3-4b82-a0cb-ff5acb3e4728 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/action" status: 200 len: 37661 microversion: 2.20 time: 0.102138 Jun 29 10:13:41.558227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 489/899] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 10:13:41 2022] POST /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574/action => generated 37661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jun 29 10:13:41.578042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:41.579286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:41.586979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.587727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.588559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.589016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.597043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:13:41.599158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: e3abafc5-b230-4d96-95f9-a9e93703a053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68f08d03-e9ee-40e8-85e0-7582bbe747ad',volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:13:41.622686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8172efd5-490c-465c-9131-642071c96c20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049314 Jun 29 10:13:41.623522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 490/900] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:13:41.707190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Request method failure captured: Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 476 Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCKR9dmMX4ZfnljRVtNizUx2dx31Fxgie544MHL0sCUIYThwNIFBoR8Bb8JljSmr2jPsUOcsyvpWnEfrli4fM6LIU-mPLGkaBYhK2kPY3vPTfQBdvlYQr92dPgDHq379agNyXQLdxYP6iQ1cOwG3ZFlhDzFn97zTHum-pb47SUkRA8I Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:41.711375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0192e4102b644993a9482674674b1ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0192e4102b644993a9482674674b1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 48ff681e601f4892abffe5862def0547 Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:41.712980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {"server": {"name": "tempest-TestVolumeBootPattern-server-303601940", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-698110575", "security_groups": [{"name": "tempest-secgroup-smoke-1483186916"}], "block_device_mapping_v2": [{"uuid": "68f08d03-e9ee-40e8-85e0-7582bbe747ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4eae6fbf-3414-4d08-88dd-e97fd883b29c"}]}} Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-303601940', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-698110575', 'security_groups': [{'name': 'tempest-secgroup-smoke-1483186916'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '68f08d03-e9ee-40e8-85e0-7582bbe747ad'}], 'networks': [{'uuid': '4eae6fbf-3414-4d08-88dd-e97fd883b29c'}]}}} Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:41.713755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise self.value Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:41.714615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:13:41.716279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise self.value Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 29 10:13:41.717758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 10:13:41.719411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise self.value Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._validate_bdm( Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:41.721182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:41.722980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:41.724960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) Jun 29 10:13:41.724960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.724960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 68f08d03-e9ee-40e8-85e0-7582bbe747ad status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-0c683d2f-2f64-4cc9-9c11-b5cdf0375e04) {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:41.724960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3f5496d-bbd0-491b-abc2-da3f1d70a611 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.040114 Jun 29 10:13:41.724960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 411/901] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:13:40 2022] POST /compute/v2.1/servers => generated 295 bytes in 1046 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:13:41.742613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:41.743602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:41.750086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.750529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.751522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:41.751958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:41.767729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 HTTP/1.1 Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:41.769416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:13:41.772445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '76483279-456b-4e8e-ad98-55f107a9d8f5'} Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:41.774061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:13:41.781722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:41.783561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:41.783561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8dda50ce-7fee-44d4-8f1c-a493bd93beda tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 404 len: 111 microversion: 2.1 time: 0.033915 Jun 29 10:13:41.783561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 491/902] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:41 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:13:41.787181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bfc0e274-3863-411e-9b09-34f157ea1719 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '.version_select at 0x7f38702bd3a0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:41.812814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bfc0e274-3863-411e-9b09-34f157ea1719 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333372682" status: 202 len: 0 microversion: 2.1 time: 0.035824 Jun 29 10:13:41.813522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 412/903] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 10:13:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333372682 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:13:42.238733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:42.239369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:42.246404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:42.246990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:42.247843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:42.248493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:42.263565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] HTTP exception thrown: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Request method failure captured: Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b HTTP/1.1 Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCKR9dmMX4ZfnljRVtNizUx2dx31Fxgie544MHL0sCUIYThwNIFBoR8Bb8JljSmr2jPsUOcsyvpWnEfrli4fM6LIU-mPLGkaBYhK2kPY3vPTfQBdvlYQr92dPgDHq379agNyXQLdxYP6iQ1cOwG3ZFlhDzFn97zTHum-pb47SUkRA8I Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:13:42.265142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0192e4102b644993a9482674674b1ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0192e4102b644993a9482674674b1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 48ff681e601f4892abffe5862def0547 Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.266609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '1bac0f78-62e4-4cd7-a3c4-5db0831d274b'} Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:42.267394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.268621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.269880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Returning 404 to user: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:42.269880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3d349ed-22f5-43eb-9905-deea97735a48 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 404 len: 111 microversion: 2.1 time: 0.032022 Jun 29 10:13:42.269880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 492/904] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:13:42 2022] DELETE /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:13:42.276543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:42.277163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [instance: 1bac0f78-62e4-4cd7-a3c4-5db0831d274b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:42.283846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:42.284288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:42.285068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:42.285498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:42.300681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] HTTP exception thrown: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Request method failure captured: Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b HTTP/1.1 Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCKR9dmMX4ZfnljRVtNizUx2dx31Fxgie544MHL0sCUIYThwNIFBoR8Bb8JljSmr2jPsUOcsyvpWnEfrli4fM6LIU-mPLGkaBYhK2kPY3vPTfQBdvlYQr92dPgDHq379agNyXQLdxYP6iQ1cOwG3ZFlhDzFn97zTHum-pb47SUkRA8I Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:13:42.302322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0192e4102b644993a9482674674b1ad7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0192e4102b644993a9482674674b1ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0192e4102b644993a9482674674b1ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 0192e4102b644993a9482674674b1ad7 Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-TestVolumeBootPattern-2110480405 Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 48ff681e601f4892abffe5862def0547 Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-TestVolumeBootPattern-2110480405-project Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.304012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '1bac0f78-62e4-4cd7-a3c4-5db0831d274b'} Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:13:42.304896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. Jun 29 10:13:42.306175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:13:42.308272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Returning 404 to user: Instance 1bac0f78-62e4-4cd7-a3c4-5db0831d274b could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:13:42.308272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e303beb-0661-4a19-8100-3c340c9e0f91 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b" status: 404 len: 111 microversion: 2.1 time: 0.032972 Jun 29 10:13:42.308272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 413/905] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:42 2022] GET /compute/v2.1/servers/1bac0f78-62e4-4cd7-a3c4-5db0831d274b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:13:42.635114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:42.636043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:42.643184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:42.643686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:42.644494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:42.644922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:42.678441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cd1ea88c-8c40-45d5-af30-e7353f959dca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047481 Jun 29 10:13:42.679644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 493/906] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:42.782203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bee945d5-6f1a-4bc4-8eb7-31150b6bb364 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: .version_select at 0x7f38702faa60>, body: {"keypair": {"name": "tempest-keypair-98468437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBffab53Fc8tBdJJYUPyr80eIdnzX294uvo2y2UWRNODJJvfenMb5zK8IXSgWfc1LLyqBVwZajSieqrjnWFg+tgVP4iQAAuzZKzJdmYWhAXBYpib7zcqSyB7YBgen+pjsA=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:42.799053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-bee945d5-6f1a-4bc4-8eb7-31150b6bb364 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:13:42.803352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-bee945d5-6f1a-4bc4-8eb7-31150b6bb364 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:13:42.833006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bee945d5-6f1a-4bc4-8eb7-31150b6bb364 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056557 Jun 29 10:13:42.833729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 414/907] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:13:42 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:43.690851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:43.691826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:43.698682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:43.699130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:43.700257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:43.700654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:43.748623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4d550837-9455-4db7-bf3a-0ef52c1ac25a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061656 Jun 29 10:13:43.749050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 494/908] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:44.278686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-955662624", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8656fd5-64f6-4a7e-ad73-3f1c4df65b17"}], "security_groups": [{"name": "tempest-securitygroup--1713852617"}], "key_name": "tempest-keypair-98468437", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:44.387222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] validate_networks() for [('e8656fd5-64f6-4a7e-ad73-3f1c4df65b17', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:13:44.762960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:44.763905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:44.771229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:44.771688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:44.772634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:44.773137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:44.804946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-304e565c-e39a-496b-b3ce-8e868cf6035a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Jun 29 10:13:44.805697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 495/909] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:45.032921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:13:45.033345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:13:45.033979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:13:45.034391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:13:45.034855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:13:45.044868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:45.045284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:45.046090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:45.046502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:45.065529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:13:45.070337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Getting quotas for user 229771b215b3492abc2c5ec38ff0d929 and project 702000a5942b41689821164e169520d8. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:13:45.084420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:13:45.086856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:13:45.145099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0509f8a6-bd25-440e-be8b-c3f18e235365 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.870564 Jun 29 10:13:45.146227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 415/910] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:13:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:13:45.161968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c180b1c-1384-44f8-962f-26d64e7376a8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:45.163426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c180b1c-1384-44f8-962f-26d64e7376a8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:45.222240 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c180b1c-1384-44f8-962f-26d64e7376a8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:45.229511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c180b1c-1384-44f8-962f-26d64e7376a8 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1239 microversion: 2.1 time: 0.074101 Jun 29 10:13:45.230126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 496/911] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:45 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:45.817716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:45.818770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:45.826725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:45.827175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:45.827958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:45.828404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:45.861470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7b0e4ac-9fb9-4ab7-a539-442cba311eeb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Jun 29 10:13:45.862030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 416/912] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:46.250102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:46.251384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:46.259663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:46.260426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:46.261217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:46.261876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:46.341126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:46.348917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-224c98fd-1813-4097-8342-6ac0465aefa0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1309 microversion: 2.1 time: 0.102738 Jun 29 10:13:46.349517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 497/913] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:46 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:46.873472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:46.874310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:46.881931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:46.882320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:46.883203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:46.883785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:46.917908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba15d704-6a95-4dec-949d-d754fb1fcae6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048385 Jun 29 10:13:46.918783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 417/914] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:47.365734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:47.367315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:47.374315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:47.374706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:47.375509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:47.375931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:47.595236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:47.603885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-092588d0-b216-4d36-b7a1-150cf74f0dcd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.242146 Jun 29 10:13:47.604464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 498/915] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:47 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:47.798350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-6c2d612d-e52d-4af7-a145-3be9a7b6c041 req-92a22bc4-b3dc-4741-9fbf-c428b8897bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b391700-0ca4-43cf-8beb-697c52208176", "tag": "c03d5a6f-b2b8-4a7c-b171-7a3f991e439c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:47.805345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:47.810884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6c2d612d-e52d-4af7-a145-3be9a7b6c041 req-92a22bc4-b3dc-4741-9fbf-c428b8897bf3 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:47.811810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6c2d612d-e52d-4af7-a145-3be9a7b6c041 req-92a22bc4-b3dc-4741-9fbf-c428b8897bf3 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:47.831673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-6c2d612d-e52d-4af7-a145-3be9a7b6c041 req-92a22bc4-b3dc-4741-9fbf-c428b8897bf3 service nova] Creating event network-changed:c03d5a6f-b2b8-4a7c-b171-7a3f991e439c for instance 8b391700-0ca4-43cf-8beb-697c52208176 on hv-cinder-76810 Jun 29 10:13:47.840127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-6c2d612d-e52d-4af7-a145-3be9a7b6c041 req-92a22bc4-b3dc-4741-9fbf-c428b8897bf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046313 Jun 29 10:13:47.841183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 418/916] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:47.931719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:47.932986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:47.939956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:47.940356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:47.941332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:47.941925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:47.976358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a06be3e2-faec-4966-a4c4-e0e0ef78a7a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050346 Jun 29 10:13:47.980645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 499/917] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:48.624129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:48.624951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:48.634322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:48.634810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:48.635574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:48.636006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:48.782750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:48.792588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-023c3de8-4b7f-401a-b8d2-ff4a1e9e8232 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.175605 Jun 29 10:13:48.793146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 419/918] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:48 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:48.988611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:48.989377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:48.996662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:48.997115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:48.997869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:48.998303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:49.028468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f11e60e6-1a19-45f2-b6c7-4a9a34cc87c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Jun 29 10:13:49.029031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 500/919] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:49.810927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:49.811731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:49.819548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:49.819996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:49.820860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:49.821369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:49.959851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:49.967792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ba0bd3f-8061-47fb-b847-fd91750c1f26 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.162071 Jun 29 10:13:49.968364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 420/920] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:49 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:50.039858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:50.040792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:50.047901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:50.048349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:50.049230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:50.049666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:50.081808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-52352efb-b570-4787-9a03-b0124231cce6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046034 Jun 29 10:13:50.082374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 501/921] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:50.985661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:50.986313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:50.993684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:50.994135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:50.994936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:50.995371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:51.096276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:51.098095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:51.109820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:51.110645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:51.111675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:51.112447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:51.149444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-428605d8-0417-4fd9-885d-e435261a9c87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059302 Jun 29 10:13:51.150371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 502/922] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:51.150551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:51.159580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-20ff874c-6ca6-4f2b-84b7-18ec0096ff5f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.177809 Jun 29 10:13:51.160662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 421/923] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:50 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:52.162315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:52.163470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:52.170338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:52.172254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:52.172254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:52.172254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:52.177781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:52.178390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:52.192933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:52.193383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:52.194242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:52.194803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:52.206020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-498ab8d6-8bf0-483d-9320-dc25a9d77e4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048175 Jun 29 10:13:52.206622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 503/924] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:52.325845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:52.333612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-516441a6-7f58-4f4d-91d3-73086438b14f tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.160011 Jun 29 10:13:52.334177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 422/925] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:52 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:53.218936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:53.219985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:53.227047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:53.227936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:53.228713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:53.229149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:53.260768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1ac0a30b-e0e0-41ae-b0d2-6f31fd6adb12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046660 Jun 29 10:13:53.262911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 504/926] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:53.340442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-31e4c875-879f-4c23-99b3-57b9a10403bd req-d676b447-5bb0-499a-a906-67fc46495ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b391700-0ca4-43cf-8beb-697c52208176", "name": "network-vif-plugged", "status": "completed", "tag": "c03d5a6f-b2b8-4a7c-b171-7a3f991e439c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:53.348925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-31e4c875-879f-4c23-99b3-57b9a10403bd req-d676b447-5bb0-499a-a906-67fc46495ebf service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:53.349519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-31e4c875-879f-4c23-99b3-57b9a10403bd req-d676b447-5bb0-499a-a906-67fc46495ebf service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:53.351959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:53.353327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:53.362002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-31e4c875-879f-4c23-99b3-57b9a10403bd req-d676b447-5bb0-499a-a906-67fc46495ebf service nova] Creating event network-vif-plugged:c03d5a6f-b2b8-4a7c-b171-7a3f991e439c for instance 8b391700-0ca4-43cf-8beb-697c52208176 on hv-cinder-76810 Jun 29 10:13:53.362714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:53.364349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:53.365989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:53.366626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:53.367569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-31e4c875-879f-4c23-99b3-57b9a10403bd req-d676b447-5bb0-499a-a906-67fc46495ebf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104095 Jun 29 10:13:53.368163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 423/927] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:53.518372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:53.527304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-23f6cae4-9913-4374-9795-d1867d147841 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.179759 Jun 29 10:13:53.527931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 505/928] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:53 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:13:54.275564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:54.276609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:54.283306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:54.283683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:54.284446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:54.284872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:54.315600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:54.321558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62d3be23-eb9d-4df0-9264-675c2ee21561 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051751 Jun 29 10:13:54.322139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 424/929] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:54.545913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:54.546484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:54.553517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:54.553984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:54.555411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:54.555847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:54.580256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:54.709039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:54.717191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-66fa9d92-2645-49ea-bc7a-60fb397c332d tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1365 microversion: 2.1 time: 0.175956 Jun 29 10:13:54.717787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 506/930] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:54 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:55.334276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:55.335243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:55.338539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:55.339510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=16 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:55.346723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:55.347187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:55.348009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:55.348571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:55.382430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4294f483-9179-46ca-8b5b-28a4e7f060fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051946 Jun 29 10:13:55.383067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 425/931] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:55.731710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:55.736304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:55.736943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:55.744230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:55.744670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:55.745476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:55.745888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:55.895363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:13:55.904702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19975fda-0caf-4171-8a68-c6ac68bf6cd0 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1556 microversion: 2.1 time: 0.173769 Jun 29 10:13:55.905321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 507/932] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:13:55 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:13:55.921311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:55.921803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:55.929004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:55.929616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:55.930334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:55.930841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:56.015694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5a0c27a-97e5-46cb-8889-aa9e8be6985b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098326 Jun 29 10:13:56.016354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 426/933] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:13:55 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:56.393765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:56.394748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:56.403699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:56.404521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:56.406040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:56.406525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:56.441029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3dc1a41b-055a-4762-bcf8-ffb070f87b0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051164 Jun 29 10:13:56.444980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 508/934] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:57.035812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-e0131484-9ea1-4941-bfde-b0275c10b8fd req-74cc8b91-5704-4066-be5e-13f20ddca933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b391700-0ca4-43cf-8beb-697c52208176", "tag": "c03d5a6f-b2b8-4a7c-b171-7a3f991e439c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:13:57.051218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e0131484-9ea1-4941-bfde-b0275c10b8fd req-74cc8b91-5704-4066-be5e-13f20ddca933 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:57.051847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e0131484-9ea1-4941-bfde-b0275c10b8fd req-74cc8b91-5704-4066-be5e-13f20ddca933 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:57.065289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-e0131484-9ea1-4941-bfde-b0275c10b8fd req-74cc8b91-5704-4066-be5e-13f20ddca933 service nova] Creating event network-changed:c03d5a6f-b2b8-4a7c-b171-7a3f991e439c for instance 8b391700-0ca4-43cf-8beb-697c52208176 on hv-cinder-76810 Jun 29 10:13:57.071463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-e0131484-9ea1-4941-bfde-b0275c10b8fd req-74cc8b91-5704-4066-be5e-13f20ddca933 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039743 Jun 29 10:13:57.072227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 427/935] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:57.459828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:57.468596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:57.485111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:57.485566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:57.486370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:57.486840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:57.526438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e6922ea5-fde4-45b4-b7e6-4c6b09314656 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077415 Jun 29 10:13:57.527297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 509/936] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:58.540545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:58.541477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:58.548851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:58.549309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:58.550106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:58.550545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:58.585334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d83269b-ffca-4cee-b467-710807670e0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Jun 29 10:13:58.586894 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 428/937] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:13:59.598467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:13:59.599633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:13:59.602790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=73 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:13:59.608864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:59.609311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:59.610086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:13:59.610518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:13:59.643069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-777c2fbc-3172-4671-8f1e-1bbd78fdbf5f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049096 Jun 29 10:13:59.647881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 510/938] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:13:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:00.656691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:00.657686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:00.665508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:00.665957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:00.666750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:00.667180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:00.698116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a0c2936-a31c-4b31-be0f-d7b5aa907613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Jun 29 10:14:00.698965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 429/939] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:01.712655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:01.713659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:01.720731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:01.721187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:01.721958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:01.722394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:01.762935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-460a7f36-9d58-4d35-8e61-422682233944 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055171 Jun 29 10:14:01.763941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 511/940] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:02.777974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:02.779428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:02.788004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:02.788631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:02.790012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:02.790455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:02.822139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bebb01f0-e6ec-4346-ac2d-6612b37c0b90 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049901 Jun 29 10:14:02.822862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 430/941] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:03.834035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:03.834993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:03.842785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:03.843236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:03.844005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:03.844438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:03.876646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2d505281-677a-45af-bf56-be551596ec6e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Jun 29 10:14:03.877115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 512/942] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:04.891537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:04.893190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:04.903163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:04.903611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:04.904393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:04.904833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:04.940849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a2821b57-7569-4980-8ddb-d23837bec121 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056067 Jun 29 10:14:04.941827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 431/943] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:05.955363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:05.956279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:05.963648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:05.964101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:05.964871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:05.965293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:06.009465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-000179ec-2c0d-4268-8f65-1a468a11c347 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057849 Jun 29 10:14:06.010327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 513/944] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:07.022791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:07.023752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:07.031424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:07.031863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:07.032622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:07.033047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:07.066521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12207d6e-a941-460c-b06d-3f8c7d879f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047643 Jun 29 10:14:07.067139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 432/945] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:08.079481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:08.080397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:08.087331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:08.087783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:08.088956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:08.089385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:08.121623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-180424aa-199c-4790-8f2d-40d4455ac979 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Jun 29 10:14:08.122085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 514/946] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:09.132978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:09.133818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:09.141803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:09.142231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:09.143120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:09.143563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:09.176131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd181eaa-a94f-4656-afac-a15965220978 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047179 Jun 29 10:14:09.176751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 433/947] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:10.188742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:10.189778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:10.197106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:10.197830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:10.198392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:10.198854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:10.230505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-878a59e2-aa1c-4dce-a33e-0fbb08d3a924 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Jun 29 10:14:10.231111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 515/948] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:11.245117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:11.246226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:11.253234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:11.253711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:11.254476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:11.254939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:11.285973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-772b8a70-d158-465c-8bfe-4d2fc6c7ae27 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047267 Jun 29 10:14:11.286534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 434/949] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:12.297861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:12.298850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:12.305915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:12.306295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:12.307093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:12.307526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:12.339874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c2b2770f-2e70-41c5-b05f-fbd2ac33c707 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Jun 29 10:14:12.340513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 516/950] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:13.353642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:13.354488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:13.361698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:13.362130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:13.362962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:13.363403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:13.393804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-95251259-9769-4f9e-9b39-3f4125f8fd37 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Jun 29 10:14:13.394370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 435/951] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:14.406756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:14.407670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:14.414638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:14.415085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:14.415852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:14.416273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:14.447653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a201c5b-6a79-4f53-bddc-569ca0a6d5d1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Jun 29 10:14:14.448210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 517/952] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:15.460709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:15.461665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:15.468936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:15.469385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:15.470139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:15.470589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:15.500968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-909b7dcb-fbcd-4e58-bd61-218993021bc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Jun 29 10:14:15.501516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 436/953] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:16.514918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:16.515850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:16.522940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:16.523388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:16.524151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:16.524584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:16.555102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-700d7a8b-bc7c-425c-a93d-093497c00bbc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Jun 29 10:14:16.555643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 518/954] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:17.572827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:17.574055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:17.584994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:17.585625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:17.586598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:17.587066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:17.617907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-00792699-ebe4-400a-9849-4aaf8fe14cdd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051400 Jun 29 10:14:17.618462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 437/955] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:18.630497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:18.631464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:18.639473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:18.639923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:18.640701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:18.641148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:18.672460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bd66f28e-1558-47aa-94a1-a71823477f50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046282 Jun 29 10:14:18.673038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 519/956] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:19.690601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:19.692199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:19.696986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=39 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:19.701105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:19.701545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:19.702307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:19.702777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:19.734604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d903b0e6-b301-415d-bd85-68d70d6cf29a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051886 Jun 29 10:14:19.735170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 438/957] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:20.746914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:20.747871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:20.755019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:20.755469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:20.756237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:20.756674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:20.786740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-498b299a-adb9-4fae-9c44-39da8a821453 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Jun 29 10:14:20.787300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 520/958] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:21.800027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:21.801306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:21.811276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:21.811966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:21.813180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:21.813876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:21.848270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51afc36a-ccfa-4aec-b1d3-dda2e372d4f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053455 Jun 29 10:14:21.848844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 439/959] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:22.860889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:22.861838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:22.868904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:22.869353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:22.870114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:22.870549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:22.902107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-34dc0f13-f73f-49dc-a974-161739951110 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Jun 29 10:14:22.902681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 521/960] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:23.915961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:23.916883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:23.925763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:23.926480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:23.927685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:23.928378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:23.966721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f1d39691-c579-4fe6-b86e-752c3c97d10f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054801 Jun 29 10:14:23.967278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 440/961] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:24.978846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:24.979781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:24.986243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:24.986727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:24.987490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:24.987923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:24.990252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=93 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:25.020317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5c06460b-84ce-4f93-8e8f-fb382a8f8c2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045207 Jun 29 10:14:25.021085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 522/962] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:26.032855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:26.033824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:26.041270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:26.041710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:26.042467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:26.042937 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:26.045646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=91 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:26.076426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5162c1f6-9e85-4c1f-9f49-a0151dc509f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047931 Jun 29 10:14:26.077121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 441/963] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:27.088799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:27.089762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:27.096641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:27.097085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:27.097848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:27.098281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:27.127730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-434b327b-a3ff-4c1c-998f-752bd5c3e259 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Jun 29 10:14:27.128260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 523/964] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:28.139384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:28.140315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:28.147281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:28.147863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:28.148845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:28.149297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:28.181003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2eee9ec3-4f4d-42b2-a1f3-71c48675e3fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Jun 29 10:14:28.181588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 442/965] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:29.193723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:29.194658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:29.202434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:29.202907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:29.203684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:29.204104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:29.242343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3af7c2cf-d3de-4464-973e-9855d1b08fca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052626 Jun 29 10:14:29.242930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 524/966] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:30.254738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:30.255681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:30.262920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:30.263385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:30.264158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:30.264583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:30.294822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-050f7de6-7aa8-4b26-8fbf-7eb45d7f30e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Jun 29 10:14:30.295386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 443/967] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:31.307289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:31.308029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:31.308835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:31.310092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:31.310795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:31.316405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:31.316847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:31.317631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:31.318051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:31.319570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:31.320025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:31.320804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:31.321244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:31.343880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0189eb05-f7b8-4c49-9e3c-1a9625b57a20 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176/ips" status: 200 len: 151 microversion: 2.1 time: 0.038578 Jun 29 10:14:31.344464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 444/968] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:14:31 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:14:31.353233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-81532664-844c-4ab4-ac13-4376b382f7fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050451 Jun 29 10:14:31.353829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 525/969] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:32.366198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:32.367221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:32.374530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:32.375006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:32.376122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:32.376265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:32.406064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-16d90d34-663e-447a-9922-15a626583998 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Jun 29 10:14:32.406653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 445/970] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:33.419468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:33.420799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:33.431038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:33.431517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:33.432613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:33.433124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:33.466431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cf81e73d-f104-4f77-823f-37cce107db7c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051652 Jun 29 10:14:33.467044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 526/971] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:34.477526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:34.478504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:34.485242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:34.485684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:34.486451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:34.486918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:34.516344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9358814-1dae-4eac-9b61-5600009f9e61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Jun 29 10:14:34.516880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 446/972] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:35.530304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:35.531284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:35.538096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:35.538552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:35.539374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:35.539811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:35.572958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-568e8962-7c2b-48b6-9363-1a9d6c0b0adf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046678 Jun 29 10:14:35.573513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 527/973] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:36.585564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:36.586468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:36.593425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:36.593876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:36.594690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:36.595121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:36.647350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cac69245-3595-4424-acec-5c704d7abb30 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065622 Jun 29 10:14:36.648538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 447/974] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:37.796505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:37.797467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:37.804098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:37.804568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:37.805317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:37.805744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:37.838933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2552e535-885c-4050-a5e5-c90b0a386e15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182739 Jun 29 10:14:37.839501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 528/975] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:38.851037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:38.851968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:38.859652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:38.860103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:38.860869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:38.861300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:38.897456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34c209f7-e57f-4622-92c1-ac51369b03b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050162 Jun 29 10:14:38.898140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 448/976] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:39.910087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:39.911071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:39.918029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:39.918464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:39.919276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:39.919706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:39.952211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df02c38b-8451-4df2-a64f-33e8517cf574 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Jun 29 10:14:39.952771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 529/977] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:40.966222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:40.967244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:40.974237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:40.974697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:40.975457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:40.975890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:41.008077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfcede01-bc2a-482f-a9d2-1c92f1f12820 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Jun 29 10:14:41.008638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 449/978] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:42.020614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:42.021561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:42.028753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:42.029201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:42.030219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:42.030655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:42.064288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-26b6d949-f967-4374-b12a-6cb78136648e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047789 Jun 29 10:14:42.065353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 530/979] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:43.078805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:43.079772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:43.086730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:43.087178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:43.087999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:43.088424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:43.118305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7f83c85-87c1-48bf-b69c-91e3b21f3480 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 Jun 29 10:14:43.118908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 450/980] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:44.130270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:44.131250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:44.138205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:44.138697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:44.139468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:44.140069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:44.170795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-249fd666-65ef-4a34-b67a-4556a8ce88e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Jun 29 10:14:44.171339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 531/981] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:45.185459 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:45.186635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:45.196582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:45.197056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:45.197820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:45.198404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:45.233335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff2bc685-2dbc-4bd0-bb7f-27d3884b748a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054336 Jun 29 10:14:45.233907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 451/982] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:46.245692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:46.247085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:46.254491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:46.254973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:46.255748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:46.256177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:46.291703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-01f08820-af31-45c3-abb2-e48982a4c0e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049987 Jun 29 10:14:46.292329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 532/983] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:47.304550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:47.305485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:47.313609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:47.313964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:47.314806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:47.315235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:47.348603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87c714e5-c543-4ea4-98f2-7d827878cb26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048008 Jun 29 10:14:47.349206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 452/984] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:48.364271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:48.365152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:48.372332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:48.372811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:48.373589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:48.374029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:48.405516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5c8a7107-748b-45c4-8e86-44c9466dd5ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048665 Jun 29 10:14:48.406098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 533/985] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:49.419623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:49.420560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:49.427521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:49.427979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:49.428750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:49.429179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:49.461345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ec0c8cad-3abf-4627-bccd-71380d30597f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046795 Jun 29 10:14:49.461935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 453/986] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:50.474397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:50.475346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:50.483003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:50.483447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:50.484213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:50.484648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:50.529012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8c5ed203-1258-48ce-a1c8-fa6a5ab74954 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058808 Jun 29 10:14:50.529780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 534/987] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:51.542605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:51.543548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:51.545961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=32 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:51.552733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:51.553213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:51.554172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:51.554668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:51.588734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-44a6bb32-0394-4ac2-933b-fd4be8dd1b9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050223 Jun 29 10:14:51.589315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 454/988] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:52.601456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:52.602396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:52.609219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:52.609669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:52.610432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:52.610902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:52.641382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d8357478-1d17-4ad5-839a-9490177bd19d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Jun 29 10:14:52.641935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 535/989] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:53.654109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:53.654959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:53.662978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:53.663426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:53.664186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:53.664612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:53.698473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9effcea4-8dd9-4b07-9b8d-11143ec019f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048453 Jun 29 10:14:53.699796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 455/990] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:54.711719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:54.714088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:54.722099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:54.722583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:54.723397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:54.723837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:54.756449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a7a6d96-e2e4-40fd-a74b-c7a33fdd5acf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049086 Jun 29 10:14:54.757038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 536/991] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:55.768936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:55.769899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:55.776884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:55.777312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:55.778122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:55.778554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:55.809959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee4f9235-6e99-41f1-83ae-ef54edcd5a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Jun 29 10:14:55.810537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 456/992] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:56.824955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:56.826308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:56.835487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:56.835943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:56.836714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:56.837144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:56.839770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:56.868914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f2efa7c-c329-4f0a-856d-9c76c03370fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048382 Jun 29 10:14:56.869490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 537/993] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:57.882306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:57.883313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:57.890002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:57.890453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:57.891255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:57.891685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:57.894152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=94 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:14:57.922335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-756eb14d-6a2c-4e2c-a1ce-40f2ff170443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Jun 29 10:14:57.922946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 457/994] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:58.934800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:58.935758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:14:58.943130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:58.943579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:58.944350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:14:58.944790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:14:58.978802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-33c3a5b8-0ca6-479c-a1da-e5d05ae847f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048025 Jun 29 10:14:58.979592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 538/995] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:14:59.992546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:14:59.993519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:00.001691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:00.002299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:00.003525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:00.003955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:00.038630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a04d860a-fde1-475f-993f-e7a657610553 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050754 Jun 29 10:15:00.039222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 458/996] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:14:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:01.051011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:01.051969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:01.059174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:01.059632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:01.060417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:01.060882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:01.092166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e6dd8fc4-4ff7-4bab-81e6-7945d0507f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045414 Jun 29 10:15:01.092779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 539/997] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:02.104305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:02.105265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:02.112190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:02.112638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:02.113408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:02.113847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:02.144657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3d0ab23-c642-437a-8e14-8a865b07be40 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Jun 29 10:15:02.145256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 459/998] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:03.156564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:03.157502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:03.159868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:15:03.165365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:03.165822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:03.166591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:03.167028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:03.198412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c05b5d34-22a5-4de9-89dc-771fd2ed0d16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Jun 29 10:15:03.199377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 540/999] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:04.211178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:04.212118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:04.219122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:04.219607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:04.220362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:04.220807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:04.253326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-754a6cd0-384b-495e-baf9-b9de33247106 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046298 Jun 29 10:15:04.253928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 460/1000] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:05.265421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:05.266349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:05.276353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:05.277150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:05.278476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:05.279315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:05.318432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-42a62f36-5a3c-4c2f-bfa2-005d7aa1f377 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056909 Jun 29 10:15:05.318969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 541/1001] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:06.330033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:06.330962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:06.338001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:06.338449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:06.339258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:06.339694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:06.369512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4a22ba6-c6dd-47d6-8dd4-8dfb76b9a07e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Jun 29 10:15:06.370090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 461/1002] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:07.381622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:07.382783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:07.389938 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:07.390382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:07.391193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:07.391619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:07.421882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-11509f97-5222-4332-89e1-458487049b52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Jun 29 10:15:07.422448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 542/1003] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:08.433897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:08.434964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:08.441915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:08.442521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:08.443432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:08.443855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:08.477024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e190631f-637c-4b0e-86ac-52e4de1ded3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Jun 29 10:15:08.477621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 462/1004] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:09.489420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:09.490672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:09.497454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:09.497906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:09.498719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:09.499159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:09.530408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8f44a4ee-3432-4716-8c23-806e54a447bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Jun 29 10:15:09.531006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 543/1005] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:09.916786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:15:09.917100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:15:10.541794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:10.542765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:10.549756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:10.550203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:10.551057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:10.551735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:10.584907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78d9bd5c-3427-4f1d-ad43-1b6303f9b72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047047 Jun 29 10:15:10.585453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 463/1006] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:11.596975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:11.597911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:11.605301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:11.605768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:11.606603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:11.607084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:11.639496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-09f19088-0283-424f-81fe-8cd528f275d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Jun 29 10:15:11.640055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 544/1007] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:12.651658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:12.652598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:12.659361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:12.659823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:12.660594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:12.661032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:12.692770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5d4df920-8bfa-413e-8fca-ed31a84d211a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Jun 29 10:15:12.693372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 464/1008] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:13.705277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:13.706227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:13.713684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:13.714140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:13.714990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:13.715460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:13.750049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-53ccf241-5a9b-437a-99f2-dcef2dbb8bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Jun 29 10:15:13.750049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 545/1009] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:14.761919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:14.762884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:14.769601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:14.770055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:14.770866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:14.771305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:14.801853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-92ba8a21-50d9-4ed0-aad8-fc856eefd47a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Jun 29 10:15:14.802428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 465/1010] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:15.814914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:15.816133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:15.823859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:15.824325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:15.825085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:15.825507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:15.859091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f34a91e-41de-448d-b921-8d04a6c3609d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049004 Jun 29 10:15:15.859689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 546/1011] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:16.873647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:16.874496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:16.881539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:16.881993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:16.882855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:16.883293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:16.915912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4f7afb8-c7f5-4fe2-8aad-f8c6683371f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Jun 29 10:15:16.916524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 466/1012] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:17.928647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:17.929484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:17.936602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:17.937045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:17.937954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:17.938393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:17.980862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-41dc5f73-acfb-4964-8b1e-afb5a02dfe70 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056154 Jun 29 10:15:17.981866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 547/1013] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:18.994178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:18.995153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:19.004562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:19.005196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:19.006418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:19.007019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:19.039460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8e4c310-29c2-4356-8b12-05d4a32164d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049338 Jun 29 10:15:19.040516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 467/1014] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:20.051916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:20.052806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:20.060439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:20.060897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:20.061675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:20.062111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:20.099350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0ef20d52-47a5-4557-bcdc-0a5216b799b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051298 Jun 29 10:15:20.103656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 548/1015] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:21.111878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:21.112799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:21.120226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:21.120679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:21.121448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:21.121883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:21.156416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d8b9f18d-d042-4b52-a351-e245a88cdb7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048516 Jun 29 10:15:21.156998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 468/1016] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:22.170344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:22.171336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:22.178772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:22.179313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:22.180101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:22.180518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:22.223747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4a810da4-65d7-4239-9d93-1f9349469d57 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058895 Jun 29 10:15:22.224337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 549/1017] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:23.238102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:23.239267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:23.241674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:15:23.247569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:23.248013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:23.248889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:23.249318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:23.282139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce38a5dd-70f0-4564-94d1-0dc7db02be4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049101 Jun 29 10:15:23.282754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 469/1018] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:24.296469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:24.297474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:24.307442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:24.308089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:24.309222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:24.309755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:24.340525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a02a53f-f758-4184-b503-4a9a7ad52616 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049988 Jun 29 10:15:24.341220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 550/1019] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:25.352389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:25.353467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:25.361999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:25.362442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:25.363237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:25.363666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:25.394859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-36f428e5-2ca2-4f44-99ac-981db3b7614d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Jun 29 10:15:25.395431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 470/1020] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:26.408827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:26.409661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:26.416450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:26.416902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:26.417739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:26.418170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:26.449798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1f01c19d-ca10-46d0-8284-0cb2abf1e9ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Jun 29 10:15:26.450372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 551/1021] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:27.461939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:27.462883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:27.470442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:27.470921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:27.471694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:27.472131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:27.503979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a74db870-ecc4-408e-b5b4-1aed87300aee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Jun 29 10:15:27.504750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 471/1022] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:28.518292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:28.519181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:28.526072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:28.526524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:28.527906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:28.528454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:28.531645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:15:28.564433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a5a76f06-3279-43ec-beb0-ab8ac232ada2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051140 Jun 29 10:15:28.565030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 552/1023] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:29.578493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:29.579327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:29.585849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:29.586294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:29.587079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:29.587526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:29.589870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:15:29.624441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ebdc0866-195c-4711-8a75-f2122a37cf8c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051131 Jun 29 10:15:29.625090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 472/1024] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:30.638156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:30.639584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:30.647170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:30.647620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:30.648378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:30.648810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:30.678302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b8ae4af9-ebf1-4661-a899-7babaae5c72d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045802 Jun 29 10:15:30.678937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 553/1025] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:31.690664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:31.691578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:31.699281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:31.699729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:31.700490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:31.700916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:31.732443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-999a0912-1723-44fc-aa9f-42f1e0d33142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045982 Jun 29 10:15:31.733025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 473/1026] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:32.745533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:32.746468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:32.754141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:32.754661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:32.755441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:32.755866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:32.786789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e6c2d714-f804-4d72-a2c9-6602448d5328 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Jun 29 10:15:32.787350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 554/1027] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:33.801321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:33.802246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:33.809179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:33.809622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:33.810377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:33.810840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:33.841567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2173502a-d2c6-4e6f-b586-75f90dec277f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Jun 29 10:15:33.842133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 474/1028] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:34.853839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:34.854720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:34.857087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:15:34.862583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:34.863040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:34.863806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:34.864216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:34.894531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dbffeb82-9048-4815-b97a-575230e52566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Jun 29 10:15:34.895257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 555/1029] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:35.906001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:35.907027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:35.914852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:35.915366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:35.916120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:35.916556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:35.952484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d8ddfeb-817e-4d56-a1b7-57b52f4625b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050356 Jun 29 10:15:35.953140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 475/1030] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:36.965108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:36.965983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:36.972992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:36.973442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:36.974215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:36.974659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:37.009177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f4d2cc64-6963-4086-8d5f-9b54d309734c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Jun 29 10:15:37.009823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 556/1031] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:38.028996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:38.029940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:38.038363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:38.038848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:38.039636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:38.040241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:38.079553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e372a75-afcf-4533-ad2f-c763bbb3cfb6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054483 Jun 29 10:15:38.080115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 476/1032] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:39.093163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:39.094053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:39.105851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:39.106533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:39.107919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:39.108478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:39.140141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d14b316c-452a-4241-b8f9-422b23873029 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051101 Jun 29 10:15:39.140708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 557/1033] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:40.152539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:40.153685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:40.160993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:40.161448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:40.162287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:40.162798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:40.194231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5d08d55-9a1a-46d9-878b-0625f12d2b9c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Jun 29 10:15:40.194835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 477/1034] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:41.208270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:41.209108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:41.216749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:41.217299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:41.218096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:41.218557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:41.248797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fcddb48e-c8d3-4505-8491-989c6fe2c2dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Jun 29 10:15:41.249343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 558/1035] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:42.263494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:42.264397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:42.274530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:42.275155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:42.276201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:42.276615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:42.309592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad44829b-a83c-488d-b312-db2ef77add0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052282 Jun 29 10:15:42.310164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 478/1036] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:43.325313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:43.326865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:43.336411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:43.336867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:43.337626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:43.338049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:43.368638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3699e78d-4c44-4bd4-9abd-18ba165c8f20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050066 Jun 29 10:15:43.369227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 559/1037] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:44.380969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:44.381925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:44.389607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:44.390062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:44.390884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:44.391310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:44.427032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e2c6e39-ee95-4421-a343-db79190efc22 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050017 Jun 29 10:15:44.427598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 479/1038] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:45.440148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:45.441008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:45.449100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:45.449552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:45.450363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:45.450848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:45.482654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fc40100d-1a32-41e0-b1c7-7f4ccc9dbd96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Jun 29 10:15:45.483234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 560/1039] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:46.497484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:46.498448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:46.505427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:46.506454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:46.507257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:46.507685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:46.538200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9a25a233-c0d2-4f36-be78-7befd264fde9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Jun 29 10:15:46.538799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 480/1040] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:47.550677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:47.551602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:47.560452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:47.561028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:47.562260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:47.562790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:47.601274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7068e678-eb38-42f1-9b87-ea65e4c59802 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054617 Jun 29 10:15:47.601849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 561/1041] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:48.616268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:48.617691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:48.626181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:48.626688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:48.627461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:48.627896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:48.658326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-383bb1ca-7d8d-4235-a68d-f07db3d37a77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047860 Jun 29 10:15:48.658944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 481/1042] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:49.670735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:49.671586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:49.678484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:49.678972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:49.679739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:49.680178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:49.719483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c19e118a-4f5d-4737-b167-9fd95de8cccd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052884 Jun 29 10:15:49.720058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 562/1043] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:50.731940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:50.732986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:50.740224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:50.740675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:50.741446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:50.741878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:50.772367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1dbeccee-e73f-437e-9a8c-0532e72b931a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Jun 29 10:15:50.772920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 482/1044] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:51.787473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:51.788526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:51.797358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:51.797810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:51.798594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:51.799044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:51.830545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b3b2a235-3a23-4fde-8a5d-19efa51143c4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Jun 29 10:15:51.831153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 563/1045] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:52.844046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:52.844995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:52.852349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:52.852796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:52.853566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:52.853994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:52.885406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae04c2cb-28da-472b-a960-10e5f4e51fb2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Jun 29 10:15:52.886002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 483/1046] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:53.900835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:53.901905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:53.910618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:53.911186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:53.912300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:53.912879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:53.950491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-92b972cb-3d21-4337-b685-8215c1d93d7d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055653 Jun 29 10:15:53.951669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 564/1047] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:54.964834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:54.965758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:54.968302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:15:54.974253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:54.974846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:54.975489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:54.975910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:55.006085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75e24812-94ec-4c13-b85f-eab5cc13667c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045257 Jun 29 10:15:55.006665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 484/1048] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:56.022362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:56.023375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:56.033163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:56.033711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:56.034544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:56.035007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:56.067743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0b7d1624-baab-4e90-860a-79cc9581f0fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051343 Jun 29 10:15:56.068297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 565/1049] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:57.081493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:57.082997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:57.089646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:57.090101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:57.090929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:57.091360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:57.121175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ebe7b45-adf3-4511-ae69-89f1f59c33c6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Jun 29 10:15:57.121750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 485/1050] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:58.133391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:58.134347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:58.143740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:58.144313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:58.145122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:58.145587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:58.178333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c045a703-22df-4530-8159-2a023992ddc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048901 Jun 29 10:15:58.178937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 566/1051] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:15:59.192149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:15:59.193172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:15:59.203325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:59.203629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:59.204399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:15:59.204835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:15:59.235488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b27639a-896c-4cf2-9ca0-045de3e8c030 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049326 Jun 29 10:15:59.236048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 486/1052] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:15:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:00.249094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:00.250207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:00.257486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:00.257936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:00.258773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:00.259195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:00.261710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:00.295748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b93a4ae-ecf8-453f-9afe-37d89d6d688a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050724 Jun 29 10:16:00.296341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 567/1053] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:01.308470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:01.309399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:01.316161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:01.316633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:01.317409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:01.317835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:01.320774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:01.350829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-94726994-0f87-4970-a653-badbc8abe3f3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046249 Jun 29 10:16:01.351364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 487/1054] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:02.364015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:02.365004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:02.374523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:02.375431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:02.376212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:02.376647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:02.406999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0609fce3-36d4-44ea-b847-fc8466e9c358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Jun 29 10:16:02.407552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 568/1055] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:03.419384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:03.420219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:03.427852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:03.428299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:03.429071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:03.429791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:03.462121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4badd63f-5ed3-471f-bdde-267bb702940c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 Jun 29 10:16:03.462714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 488/1056] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:04.474945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:04.475947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:04.483526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:04.484017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:04.485056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:04.485546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:04.515498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-486125e9-101e-40bb-b33c-13ba43e5840e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Jun 29 10:16:04.516351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 569/1057] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:05.528152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:05.529083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:05.536078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:05.536447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:05.537224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:05.537656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:05.575076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d631d432-ce5a-46c5-be2b-e2380a634996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050919 Jun 29 10:16:05.575644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 489/1058] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:16:06.589887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:06.590751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:06.593061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:06.598865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:06.599314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:06.600151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:06.600587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:06.630738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f32abc51-59c2-4c16-93e2-195a8dd72fef tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Jun 29 10:16:06.631303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 570/1059] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:06.749833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:16:06.750759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:16:07.644383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:07.645268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:07.652628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:07.653097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:07.653888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:07.654358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:07.684182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45e70ddb-6fa2-4e9f-aa1b-d0c6dbedb244 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Jun 29 10:16:07.684739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 490/1060] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:08.699615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:08.700714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:08.708453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:08.708901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:08.709668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:08.710104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:08.742132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9824160e-4d1c-41de-ba01-0ab688e410e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049516 Jun 29 10:16:08.742745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 571/1061] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:16:09.762209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:09.763833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:09.774770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:09.775541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:09.776862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:09.777575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:09.815254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d90285f-3255-46f3-b1c3-bd377dfd3a96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060379 Jun 29 10:16:09.815728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 491/1062] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:10.830998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:10.832238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:10.842732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:10.843355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:10.844502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:10.845093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:10.875502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-126367fd-1fa2-44c8-8b2b-c9afc8495fd8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050627 Jun 29 10:16:10.876059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 572/1063] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:11.887779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:11.888615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:11.896265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:11.896711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:11.897478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:11.897898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:11.939948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e4be02a-9568-4408-a288-04fb87d5f826 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056170 Jun 29 10:16:11.940525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 492/1064] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:12.952503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:12.953476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:12.960577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:12.961023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:12.961791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:12.962213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:12.996143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4aa32aab-eaba-4b4d-96b4-c6c3f7e9cf68 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047657 Jun 29 10:16:12.996700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 573/1065] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:14.008306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:14.009517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:14.018963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:14.019570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:14.020437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:14.020902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:14.052267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d346f98e-72a5-414f-944d-d82a1f3560b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047989 Jun 29 10:16:14.052996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 493/1066] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:15.064798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:15.065734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:15.072935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:15.073378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:15.074141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:15.074602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:15.105116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1d90ab2c-38f3-4d1e-9da0-137537a92e6c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Jun 29 10:16:15.105690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 574/1067] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:16.117750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:16.118720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:16.125630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:16.126081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:16.126881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:16.127311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:16.161059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f83fa14-0c57-49da-a9cb-2ef440a2d125 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047365 Jun 29 10:16:16.161623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 494/1068] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:17.174393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:17.175375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:17.182438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:17.182929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:17.183702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:17.184130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:17.215286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-055bd68e-d829-408f-8534-4b72357fd2fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Jun 29 10:16:17.215886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 575/1069] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:18.227594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:18.228515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:18.235510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:18.235957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:18.236712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:18.237142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:18.268069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b39c5e53-3180-49ed-b16c-e14b8615290d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Jun 29 10:16:18.268635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 495/1070] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:19.280289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:19.281230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:19.288715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:19.289154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:19.289915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:19.290342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:19.321074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-beceae13-3a4d-4e17-bafc-007d6a379613 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Jun 29 10:16:19.321901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 576/1071] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:20.336814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:20.337667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:20.345587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:20.346045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:20.346878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:20.347327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:20.384272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-636410d1-9ba9-418a-8d21-a6ce1295937d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051541 Jun 29 10:16:20.384691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 496/1072] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:21.401829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:21.403409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:21.412118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:21.412569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:21.413550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:21.413831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:21.445104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75baf62c-ee69-44bc-affe-cdffb98e3268 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053204 Jun 29 10:16:21.445667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 577/1073] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:22.457599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:22.458896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:22.465793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:22.466335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:22.467434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:22.467946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:22.500448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a75f382-6497-45e8-ac27-aa8a5001d895 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 Jun 29 10:16:22.501016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 497/1074] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:23.516620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:23.517760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:23.525754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:23.526202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:23.527003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:23.527437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:23.557775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c6a8c8aa-8181-4247-8b78-e32374ae4e1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048123 Jun 29 10:16:23.558312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 578/1075] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:24.570232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:24.571478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:24.578936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:24.579381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:24.580145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:24.580575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:24.611343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e03a2c56-fe02-4d6c-902b-9e4fc19a1974 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 Jun 29 10:16:24.611904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 498/1076] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:25.624097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:25.624932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:25.632206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:25.632675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:25.633464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:25.633899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:25.664493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-73613c12-bf17-4d91-b53c-a51f4bd196b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Jun 29 10:16:25.665044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 579/1077] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:26.678965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:26.680034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:26.683228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:26.690799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:26.691400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:26.692426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:26.692997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:26.726590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-55f2aed6-13d3-4bd6-97f2-c35a0969d8aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053068 Jun 29 10:16:26.727161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 499/1078] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:27.741803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:27.743154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:27.750769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:27.751216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:27.751985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:27.752418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:27.783076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-de7060c1-6113-4afc-b875-9a7a9b81d2a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048005 Jun 29 10:16:27.783617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 580/1079] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:28.799177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:28.800167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:28.809731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:28.810394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:28.811538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:28.811972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:28.845369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-580fa960-757e-415b-a24b-94ac92abd025 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052932 Jun 29 10:16:28.845933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 500/1080] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:29.858805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:29.859645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:29.866492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:29.866970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:29.867750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:29.868180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:29.902792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c2a1bee9-bb7f-4407-a566-c386e6e1ad45 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Jun 29 10:16:29.903387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 581/1081] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:30.916145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:30.916967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:30.924088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:30.924537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:30.925330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:30.925857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:30.957029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3c44238-3b4a-4158-9bf5-582f00e3f3d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Jun 29 10:16:30.957575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 501/1082] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:31.969318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:31.970298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:31.977321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:31.977740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:31.978691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:31.979113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:31.981516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:32.011153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0421916e-fb0f-4aa9-a87f-4fc6af198a12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Jun 29 10:16:32.011718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 582/1083] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:33.025296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:33.026660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:33.033661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:33.034107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:33.034908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:33.035338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:33.037668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:33.068955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-283592c3-4ef3-42b3-ae42-49154ff77905 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Jun 29 10:16:33.069586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 502/1084] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:34.081805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:34.082767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:34.090359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:34.090841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:34.091603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:34.092034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:34.123249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2189161d-9140-45ee-bd57-996307e2dd4f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Jun 29 10:16:34.123816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 583/1085] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:35.137880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:35.138748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:35.145585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:35.146037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:35.146943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:35.147380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:35.180069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4bc7c6f5-b19a-4643-898f-f24fe41e6788 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046965 Jun 29 10:16:35.180648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 503/1086] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:36.192529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:36.193446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:36.200771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:36.201224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:36.201994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:36.202433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:36.232800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0afe6a7d-c0d3-4d5e-bd84-0fa7333a94c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Jun 29 10:16:36.233372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 584/1087] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:16:36.271695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:16:36.272271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:16:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:16:37.247064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:37.248320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:37.258888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:37.259500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:37.260517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:37.260966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:37.292567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1faace00-bcae-401b-9049-786b2c54995b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050839 Jun 29 10:16:37.296356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 504/1088] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:38.304172 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:38.305115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:38.307456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:38.313452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:38.313916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:38.314719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:38.315150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:38.345731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7fbe70d3-f3d7-42fd-b4a3-2eebb0b5b637 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Jun 29 10:16:38.346305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 585/1089] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:39.357586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:39.358514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:39.365272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:39.365696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:39.366455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:39.366930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:39.399987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6c6e1835-c60b-48b2-bcd0-1bb9bdf4dbb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Jun 29 10:16:39.400614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 505/1090] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:40.412036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:40.412972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:40.423932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:40.424499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:40.425643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:40.426319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:40.464181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0d2bd4c8-4779-4778-b7e5-3fac5316184b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056108 Jun 29 10:16:40.465102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 586/1091] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:41.478530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:41.479587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:41.487146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:41.487606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:41.488418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:41.488839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:41.519513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1103324c-cc9d-4333-8d75-e267bb51ce47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046405 Jun 29 10:16:41.520136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 506/1092] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:42.531745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:42.533612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:42.540622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:42.541081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:42.541837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:42.542263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:42.574343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c6997773-b1e0-4783-a30a-ff104cccf404 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Jun 29 10:16:42.574941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 587/1093] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:43.587276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:43.588229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:43.595074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:43.595717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:43.596706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:43.597139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:43.627326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3d4ebe4-176a-401c-b459-c3bbd26d35b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Jun 29 10:16:43.627890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 507/1094] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:44.638464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:44.639423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:44.646897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:44.647335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:44.648102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:44.648530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:44.679450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-383cbcb5-869e-4bbe-8c85-82328a048e26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Jun 29 10:16:44.680034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 588/1095] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:45.695627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:45.697468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:45.708082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:45.708795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:45.710035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:45.710789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:45.744466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1180341d-ee9a-41ca-9462-02b25be59eaf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055594 Jun 29 10:16:45.745049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 508/1096] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:46.756755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:46.758190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:46.765113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:46.765631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:46.766348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:46.766790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:46.797832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-42025503-e42d-4cfc-b49e-1d1ab9881e1e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Jun 29 10:16:46.798384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 589/1097] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:47.810165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:47.810852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:47.818660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:47.819032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:47.819806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:47.820234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:47.853549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b552872f-29c0-4729-8a1a-23f4b10bb98e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 Jun 29 10:16:47.854109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 509/1098] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:48.865860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:48.866860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:48.873720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:48.874177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:48.875004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:48.875440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:48.907018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-095f28c5-1f56-45a8-8d77-7684391de90a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Jun 29 10:16:48.907614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 590/1099] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:49.918428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:49.919884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:49.927701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:49.928144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:49.928930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:49.929376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:49.964265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a89197b2-de30-4859-bd36-41405e30216c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049598 Jun 29 10:16:49.964999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 510/1100] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:50.976742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:50.977855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:50.984750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:50.985255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:50.986061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:50.987025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:51.018742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-664cf300-96b7-4612-89c0-8b7b75af0b24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046709 Jun 29 10:16:51.019355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 591/1101] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:52.031759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:52.032638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:52.040006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:52.040472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:52.041260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:52.041868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:52.074020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05f35557-d7dd-4c4f-b6d6-099334ffde50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Jun 29 10:16:52.074605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 511/1102] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:53.085957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:53.086923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:53.093993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:53.094442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:53.095230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:53.095843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:53.127389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19d90541-fedd-44d5-bb31-b459cd20ba87 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Jun 29 10:16:53.128067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 592/1103] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:54.139812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:54.140741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:54.147809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:54.148214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:54.149018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:54.149454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:54.183232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e5dd2d7-d612-40c8-9194-3f2ef7a2f4a1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047592 Jun 29 10:16:54.183843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 512/1104] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:55.196344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:55.197642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:55.204451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:55.204902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:55.205671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:55.206106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:55.237128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-281fc3bc-2891-4e84-a791-9346916721e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Jun 29 10:16:55.237937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 593/1105] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:56.251540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:56.252657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:56.260391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:56.260851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:56.261612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:56.262054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:56.292798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-991caa90-958d-40b7-b9f3-c96e48d337c5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Jun 29 10:16:56.293214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 513/1106] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:57.309402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:57.310625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:57.320274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:57.320719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:57.321484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:57.322304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:57.353862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-099c45b6-70b7-48a0-8b84-ca8edd58c3d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051808 Jun 29 10:16:57.354377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 594/1107] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:57.809224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:16:57.809848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:16:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:16:58.365900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:58.366869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:58.368839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:16:58.374972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:58.375433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:58.376221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:58.376654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:58.407790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-af34ded5-4d2b-4356-8bab-2c111bc42fb4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046024 Jun 29 10:16:58.408356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 514/1108] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:16:59.423424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:16:59.424876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:16:59.434099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:59.434840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:59.436014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:16:59.436448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:16:59.471553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a186f31-afdc-4b13-9fbe-b0deb17173fc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054343 Jun 29 10:16:59.472140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 595/1109] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:16:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:00.284882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:17:00.284882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:17:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:17:00.484417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:00.485421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:00.493528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:00.493844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:00.494725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:00.495163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:00.537444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9821cb6e-f424-415c-8223-ba5a11cb5001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057457 Jun 29 10:17:00.537974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 515/1110] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:17:01.550458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:01.551493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:01.558226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:01.558686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:01.559604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:01.560134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:01.595594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a9d243b0-1e10-4a68-9276-7163be935443 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048988 Jun 29 10:17:01.596435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 596/1111] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:02.609655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:02.610593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:02.617709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:02.618157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:02.618956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:02.619388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:02.649829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-78a68f00-ccdb-4637-a692-89fa8260641c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Jun 29 10:17:02.650423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 516/1112] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:03.664317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:03.665410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:03.672907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:03.673360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:03.674263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:03.674520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:03.677064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:03.707361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1b8c0d64-eb73-4413-b0d3-d56cc8819a0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049070 Jun 29 10:17:03.707986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 597/1113] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:04.722678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:04.724130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:04.730600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:04.731091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:04.731800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:04.732505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:04.736100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:04.762278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da657886-fc6e-479b-b84d-e982fad7da11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046086 Jun 29 10:17:04.762885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 517/1114] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:05.778329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:05.779682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:05.787568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:05.788026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:05.788795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:05.789265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:05.819935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e195c178-3b31-4ba5-971c-f5e96583abd1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047817 Jun 29 10:17:05.820530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 598/1115] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:06.832502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:06.833463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:06.840576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:06.841024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:06.841845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:06.842247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:06.872617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50b63c69-05ca-4145-a0d3-f92ae1edc08a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Jun 29 10:17:06.873303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 518/1116] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:07.885344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:07.886284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:07.893688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:07.894138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:07.895001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:07.895383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:07.925612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d95ddbcc-9ad5-48b3-ba79-ba2af5b3882b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Jun 29 10:17:07.926187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 599/1117] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:08.937625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:08.938538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:08.945531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:08.945992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:08.947145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:08.947573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:08.983581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a81dbcc7-7cbf-4206-8a92-ce6fc4e708ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049891 Jun 29 10:17:08.984079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 519/1118] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:09.995551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:09.996481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:09.999082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:10.005177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:10.005635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:10.006406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:10.006887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:10.037436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-88760be3-36b8-4b31-a0f3-914404e6198f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045962 Jun 29 10:17:10.037989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 600/1119] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:11.050183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:11.058611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:11.066246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:11.066798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:11.067586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:11.067977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:11.102287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a1e5970-f309-4ede-9f91-7814f95cb8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056067 Jun 29 10:17:11.102904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 520/1120] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:12.114051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:12.115045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:12.121812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:12.122261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:12.123058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:12.123490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:12.154308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-132d24a4-a79b-42ce-990b-22fd8ccf6719 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Jun 29 10:17:12.155150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 601/1121] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:13.168242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:13.169814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:13.177764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:13.178306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:13.179137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:13.179566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:13.213098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3ef1379-c022-490d-ab86-325ea19cb4e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051101 Jun 29 10:17:13.213650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 521/1122] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:14.227184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:14.228612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:14.238276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:14.238784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:14.239545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:14.239973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:14.271917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a55fe61d-67ef-4097-b7f4-6753b018d538 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051008 Jun 29 10:17:14.272692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 602/1123] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:15.284741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:15.285676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:15.292704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:15.293156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:15.293984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:15.294342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:15.325291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14821e7b-1fd2-4469-adcf-31971c7b2942 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Jun 29 10:17:15.325847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 522/1124] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:16.337979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:16.339299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:16.349108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:16.349859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:16.351034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:16.351682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:16.384821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-10ca0894-60dd-4a82-ac9b-6da5ed5a3c3f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051464 Jun 29 10:17:16.388749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 603/1125] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:17.396957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:17.398050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:17.407671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:17.408122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:17.408891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:17.409317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:17.440550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4ad9953-fc06-4a05-a81c-2166dd88a710 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Jun 29 10:17:17.441317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 523/1126] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:18.452686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:18.453635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:18.460500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:18.460963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:18.461731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:18.462167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:18.491977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8f802ea7-c0b5-4b75-bfc8-504ce3de832b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 Jun 29 10:17:18.492885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 604/1127] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:19.503784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:19.504818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:19.511591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:19.512040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:19.512813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:19.513241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:19.551548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-852a49d3-1b90-469c-8283-d3237a631a26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051613 Jun 29 10:17:19.552116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 524/1128] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:20.562817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:20.563781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:20.572103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:20.572547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:20.573323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:20.573753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:20.604992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6bf47039-2a8a-4acc-b05b-e0b8b584106f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Jun 29 10:17:20.605569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 605/1129] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:21.617322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:21.618261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:21.624875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:21.625325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:21.626090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:21.626521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:21.659463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8e1c5bb4-6737-4cb8-bf82-3aa5a4e5e88e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Jun 29 10:17:21.660018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 525/1130] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:22.672512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:22.673566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:22.680778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:22.681374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:22.682270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:22.682739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:22.714159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3e4c978d-4d19-49b9-89b5-81d53aefbfd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Jun 29 10:17:22.714923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 606/1131] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:23.725777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:23.726942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:23.733803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:23.734267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:23.735079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:23.735757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:23.766389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ad1d6a1-9646-4ac6-a66d-1df7ae072888 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Jun 29 10:17:23.767580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 526/1132] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:24.777410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:24.778344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:24.784601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:24.785052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:24.785819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:24.786254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:24.815773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8e697f29-0ed9-44aa-8818-a960b1a3e5c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042194 Jun 29 10:17:24.816322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 607/1133] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:25.827957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:25.828973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:25.835703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:25.836093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:25.836993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:25.837427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:25.877085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f37c4f6-399c-434b-985f-ea044589778a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053024 Jun 29 10:17:25.881317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 527/1134] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:26.889457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:26.890392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:26.896961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:26.897411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:26.898266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:26.898757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:26.930517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-efb60949-ab39-4680-b0ec-b7ffe7ba9875 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Jun 29 10:17:26.931127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 608/1135] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:27.941334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:27.942909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:27.950267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:27.950759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:27.951549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:27.951986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:27.982003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e298d7d-72d3-4417-bfea-0fe94d22ed10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Jun 29 10:17:27.983579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 528/1136] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:28.994065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:28.994672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:29.001695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:29.002134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:29.002946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:29.003376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:29.033559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f7e74a4e-5754-4191-99b3-e2c1f535d6be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Jun 29 10:17:29.034319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 609/1137] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:30.047106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:30.047965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:30.060242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:30.064560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:30.065012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:30.065790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:30.066228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:30.104510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c286576-7093-4d6f-99af-3dabe130f5e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062325 Jun 29 10:17:30.105098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 529/1138] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:31.117263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:31.118208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:31.125648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:31.126096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:31.126917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:31.127346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:31.158707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c0371b41-1235-4799-a819-dfba7d6cd4cb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Jun 29 10:17:31.162470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 610/1139] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:32.171288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:32.172088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:32.178711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:32.179165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:32.179935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:32.180461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:32.210376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-29837825-ad7a-4ace-825e-e1466776af0a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Jun 29 10:17:32.211096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 530/1140] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:33.222736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:33.223670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:33.230937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:33.231312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:33.232097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:33.232521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:33.263334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4ffd9e7d-a49b-401c-96eb-9f9ea17b81fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Jun 29 10:17:33.263907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 611/1141] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:34.275414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:34.276388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:34.283973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:34.284420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:34.285176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:34.285602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:34.316534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-950ae02f-f432-4361-955e-dcf424b9a6ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Jun 29 10:17:34.317099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 531/1142] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:35.328888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:35.329955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:35.336620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:35.337081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:35.337855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:35.338295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:35.340819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:35.369275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-55b83e2c-1868-4bfd-80a2-112581765323 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044365 Jun 29 10:17:35.369848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 612/1143] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:36.381186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:36.382138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:36.389089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:36.389540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:36.390303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:36.390884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:36.393271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:36.423676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-19710abb-c31c-42b4-bad5-fe66c346dffc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046513 Jun 29 10:17:36.424251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 532/1144] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:37.435733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:37.436691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:37.443472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:37.443926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:37.444691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:37.445112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:37.475069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cf0c1e0b-f14d-4681-b77e-c1b7f6650b91 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Jun 29 10:17:37.475614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 613/1145] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:38.487806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:38.488776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:38.495926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:38.496650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:38.497368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:38.497821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:38.527535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9a13ee29-57f5-4fb8-bc51-9d79aadecd08 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Jun 29 10:17:38.528117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 533/1146] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:39.542235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:39.543460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:39.550842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:39.551275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:39.551946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:39.552377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:39.583030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4fd73049-16e9-4a36-8cd8-692b10c4cd07 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046482 Jun 29 10:17:39.583698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 614/1147] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:40.596329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:40.597230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:40.604385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:40.604835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:40.605586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:40.605994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:40.637375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-80468137-db6f-4c02-a86e-0264f138c00f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Jun 29 10:17:40.637942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 534/1148] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:41.650313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:41.651296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:41.654995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:17:41.661117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:41.661570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:41.662361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:41.662839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:41.697502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5cb90aa7-b647-48df-bdb4-e260b4f7fece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051456 Jun 29 10:17:41.698045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 615/1149] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:42.710266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:42.711243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:42.719067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:42.719521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:42.720300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:42.720734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:42.752427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-15e2a91d-6bc5-4321-a74d-8f4419939460 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046431 Jun 29 10:17:42.753011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 535/1150] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:43.766964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:43.768263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:43.775893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:43.776374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:43.777206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:43.777898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:43.809914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca7cdae7-cfcf-42e3-ab90-fc4de6151f03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048891 Jun 29 10:17:43.810493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 616/1151] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:44.827849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:44.829354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:44.836432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:44.836902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:44.837690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:44.838132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:44.887714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2591111-c2c7-438c-b84e-e4132ca53c5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067596 Jun 29 10:17:44.888547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 536/1152] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:45.903249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:45.904156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:45.911731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:45.912178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:45.912921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:45.913368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:45.952144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91be4b0c-0396-4a4f-a408-48a1c633936d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052876 Jun 29 10:17:45.952898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 617/1153] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:46.968650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:46.969677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:46.976715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:46.977173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:46.977948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:46.978384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:47.009347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb55468f-ba59-461c-89dc-1a0aabbe2f2d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046865 Jun 29 10:17:47.009839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 537/1154] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:48.021950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:48.022970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:48.030429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:48.030956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:48.032000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:48.032466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:48.065301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7703d8bf-3cf6-4b9b-a57a-7b9d64a9dd63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047694 Jun 29 10:17:48.065881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 618/1155] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:49.077295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:49.078216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:49.085433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:49.085881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:49.086695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:49.087113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:49.117596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d64dbc9-1b0b-4491-ac81-7090158f8163 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Jun 29 10:17:49.118433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 538/1156] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:50.129816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:50.130817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:50.137990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:50.138442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:50.139273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:50.139711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:50.171468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d0ff80cb-49fe-4b69-be66-819a94eb8251 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Jun 29 10:17:50.172270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 619/1157] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:51.183993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:51.184930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:51.191957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:51.192411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:51.193165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:51.193594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:51.228991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b11256df-c3b4-478c-a99f-3676f429f280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048900 Jun 29 10:17:51.229814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 539/1158] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:52.241997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:52.243078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:52.249796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:52.250254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:52.251014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:52.251444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:52.282843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-74aac279-add0-46f9-b576-3c7c1397f07c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Jun 29 10:17:52.283553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 620/1159] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:53.297746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:53.299372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:53.308989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:53.309505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:53.310645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:53.311233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:53.343306 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-741296d5-38bc-4a65-bfda-008dca01ec2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051277 Jun 29 10:17:53.343875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 540/1160] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:54.356081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:54.356934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:54.363463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:54.363912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:54.364665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:54.365121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:54.395728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1931bac6-73ed-4dd8-b7df-0f455a8781a3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Jun 29 10:17:54.396490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 621/1161] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:55.408394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:55.409234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:55.416384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:55.416874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:55.417727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:55.418183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:55.454499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e042cfb-3579-4a67-ad71-3caeb52504a4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050301 Jun 29 10:17:55.455457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 541/1162] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:56.469248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:56.470339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:56.479816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:56.480343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:56.481519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:56.482116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:56.525142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9771666c-de1d-40c7-b99a-2441fdf8fcc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061716 Jun 29 10:17:56.525991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 622/1163] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:57.538350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:57.539497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:57.549814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:57.550366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:57.551286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:57.551813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:57.587861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4bf6d706-9cdc-4a16-986e-2dd3128571f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054270 Jun 29 10:17:57.588453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 542/1164] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:58.601730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:58.603227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:58.609936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:58.610392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:58.611201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:58.611978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:58.656203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-298d862e-167b-466b-bf9e-68c87e260376 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058438 Jun 29 10:17:58.657002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 623/1165] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:17:59.668916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:17:59.669835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:17:59.676849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:59.677297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:59.678048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:17:59.678473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:17:59.710750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b8272a3-4dfc-487d-a6d0-00ee56e03ae4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Jun 29 10:17:59.711316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 543/1166] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:17:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:00.722543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:00.723890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:00.731325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:00.731781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:00.732551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:00.732983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:00.764739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75f623c1-641d-470a-8e20-2b3300a74d32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Jun 29 10:18:00.765943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 624/1167] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:01.777875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:01.778866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:01.781624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:01.788176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:01.788619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:01.789384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:01.789811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:01.820329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-86fe6c65-c43a-4617-b1db-c77cddac1af3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Jun 29 10:18:01.821261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 544/1168] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:02.834379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:02.835358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:02.842374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:02.842853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:02.843633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:02.844083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:02.875770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bce1018f-1c5a-4a6d-b709-c5ad7b0a3c98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Jun 29 10:18:02.876193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 625/1169] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:03.887899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:03.888822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:03.895853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:03.896272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:03.897025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:03.897469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:03.927015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b053c17e-9d6c-4b23-ac31-0b85bc62e5e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Jun 29 10:18:03.927580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 545/1170] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:04.942518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:04.943526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:04.950912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:04.951407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:04.952180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:04.952617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:04.993592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f2d35736-1862-4579-802c-d5e6e49190fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057560 Jun 29 10:18:04.994164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 626/1171] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:06.008674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:06.009703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:06.019911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:06.020518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:06.021289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:06.021724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:06.052932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0feecab2-e074-4640-a7d0-c14ca709dc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050224 Jun 29 10:18:06.053446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 546/1172] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:07.068453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:07.069400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:07.076953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:07.077398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:07.078161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:07.078595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:07.081002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:07.110875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7cfef303-9106-4fc4-9d57-19f6eb25a98b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049020 Jun 29 10:18:07.111435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 627/1173] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:08.123216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:08.124147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:08.131531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:08.131974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:08.132728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:08.133137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:08.135577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:08.170030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77ae8cb4-6f89-4659-8920-3153ac569229 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050407 Jun 29 10:18:08.170955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 547/1174] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:09.183402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:09.184335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:09.191366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:09.191815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:09.192573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:09.193020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:09.229981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c42500ad-b700-454b-b0e7-7e2b96624b26 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050634 Jun 29 10:18:09.230552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 628/1175] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:10.243195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:10.244124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:10.250917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:10.251401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:10.252166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:10.252599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:10.284765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cbaa0a3e-b0a4-4dcc-9960-cdb77050e3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 Jun 29 10:18:10.285328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 548/1176] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:11.299398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:11.300243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:11.307277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:11.307725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:11.308484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:11.308916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:11.339747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9e3e3e3d-fdd0-4ae9-98c9-fa95cf31db02 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Jun 29 10:18:11.340311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 629/1177] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:12.351657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:12.352531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:12.359299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:12.359773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:12.360527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:12.360953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:12.391507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c57e58e-d8bf-4c32-b486-0b0593b2e7f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Jun 29 10:18:12.394754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 549/1178] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:13.406605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:13.407730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:13.411266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:13.419563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:13.420269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:13.421531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:13.422254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:13.456094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a8b60d58-5ee3-4302-b8f3-a186c21e9847 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055570 Jun 29 10:18:13.456634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 630/1179] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:14.470545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:14.471582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:14.480115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:14.480561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:14.481325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:14.481757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:14.514631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75805634-ef65-4b05-9e4c-452f468d20a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049628 Jun 29 10:18:14.515320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 550/1180] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:15.530176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:15.531143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:15.538027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:15.538475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:15.539265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:15.539692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:15.569838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3f6143f6-7c22-44d0-b91f-c3acacc3e624 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Jun 29 10:18:15.570721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 631/1181] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:16.585428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:16.586694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:16.596413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:16.597005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:16.598010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:16.598627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:16.636977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bfa71af5-16d5-4ccd-a65a-bab479cd4629 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056825 Jun 29 10:18:16.637539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 551/1182] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:17.650290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:17.651292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:17.658489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:17.658976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:17.659742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:17.660170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:17.693862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c5b9432-94e1-4f43-94e8-aae0dfe4fd75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Jun 29 10:18:17.694513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 632/1183] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:18.706450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:18.707391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:18.715109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:18.715585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:18.716349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:18.716803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:18.747475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2b613197-201e-42db-8ddd-29f937b8e247 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045030 Jun 29 10:18:18.748017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 552/1184] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:19.761806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:19.763411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:19.770378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:19.770860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:19.771620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:19.772048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:19.802362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b02c626-6361-4271-9cb7-8246fbb5fc20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Jun 29 10:18:19.802975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 633/1185] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:20.814790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:20.815802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:20.823860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:20.824364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:20.825223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:20.825739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:20.856623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03217ff2-b6a3-40e1-8bd1-4e07afc19851 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046201 Jun 29 10:18:20.857202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 553/1186] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:21.871408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:21.872674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:21.882170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:21.882831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:21.883894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:21.884476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:21.918150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d5fe12f6-ef41-4c81-9eed-9a59ea6d737e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052811 Jun 29 10:18:21.918741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 634/1187] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:22.933697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:22.934999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:22.941839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:22.942301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:22.943109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:22.943551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:22.975248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da9d2492-7b72-44e2-a03d-7975d5cc4d5e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Jun 29 10:18:22.975833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 554/1188] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:23.989587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:23.990745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:24.000426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:24.000875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:24.001923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:24.002528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:24.034892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-36ce31bc-c111-4fe0-b181-74c48d47fbbb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050919 Jun 29 10:18:24.035359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 635/1189] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:25.050006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:25.051432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:25.061989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:25.062310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:25.063125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:25.063585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:25.095883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8eec3902-9646-4bb6-88bd-725b9abedff6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051929 Jun 29 10:18:25.096416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 555/1190] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:26.108776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:26.109723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:26.116770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:26.117229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:26.118021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:26.118443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:26.155646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f14e1b78-7a8b-4085-a778-3b9c24f4363e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051246 Jun 29 10:18:26.156146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 636/1191] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:27.167963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:27.168929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:27.176281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:27.176735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:27.177501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:27.177931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:27.208275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3068785c-57d3-4f0d-bbcf-59ee5109a920 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Jun 29 10:18:27.208834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 556/1192] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:28.220971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:28.221916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:28.229721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:28.230223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:28.231056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:28.231516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:28.265340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-83bfcacd-828b-408f-9b58-e42032ba6f41 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048615 Jun 29 10:18:28.265911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 637/1193] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:29.279936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:29.281169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:29.291083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:29.291671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:29.292819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:29.293461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:29.324394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f7a0cff-b56b-4ba0-bc53-208fe748f8f2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050523 Jun 29 10:18:29.325034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 557/1194] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:29.927046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:18:29.927700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:18:30.338273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:30.339716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:30.348039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:30.348492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:30.349235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:30.349730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:30.381217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8805e07b-7a7e-4b5c-804a-231cb3d90d7b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Jun 29 10:18:30.381779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 638/1195] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:31.394916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:31.395878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:31.403157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:31.403610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:31.404378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:31.404801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:31.436480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-90604a81-847f-4aa8-b9fb-34917da1482d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Jun 29 10:18:31.437026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 558/1196] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:32.453394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:32.454246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:32.461201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:32.461662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:32.462433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:32.462881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:32.500429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fc8e9e0d-b250-4103-a1a6-906c732b3b44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052676 Jun 29 10:18:32.500993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 639/1197] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:33.515537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:33.516760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:33.520551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:33.529232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:33.529954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:33.531231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:33.531669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:33.563910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57d23ff6-c3ec-42be-92e7-eb97dd12f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055148 Jun 29 10:18:33.564504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 559/1198] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:34.579197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:34.580135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:34.586772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:34.587222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:34.587984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:34.588411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:34.618577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1508149c-feff-48cf-8008-2672c6828cb8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Jun 29 10:18:34.619154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 640/1199] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:35.629860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:35.630852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:35.638012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:35.638455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:35.639261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:35.639694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:35.669740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb5eb44d-956d-48c7-8fff-88193018a6ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Jun 29 10:18:35.670265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 560/1200] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:36.681600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:36.682540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:36.689830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:36.690284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:36.691099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:36.691537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:36.721204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-08c58c35-3099-4da1-a17a-63c0818eee46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Jun 29 10:18:36.721762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 641/1201] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:37.733254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:37.734178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:37.743750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:37.744526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:37.745836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:37.746401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:37.777891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-709d143f-bc91-4b9a-adb9-8879ef3517ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048531 Jun 29 10:18:37.778772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 561/1202] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:38.792186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:38.792186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:38.798051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:38.799015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:38.799378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:38.799823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:38.802551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:38.832347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b1f8b99b-afe1-41c7-b495-f21c2560768d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Jun 29 10:18:38.832953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 642/1203] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:39.844949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:39.846024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:39.854142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:39.854738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:39.855678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:39.856256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:39.862172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:39.892916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a9470e8-8b41-41f1-a022-c229599d92fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051739 Jun 29 10:18:39.893503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 562/1204] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:40.904331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:40.905351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:40.913298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:40.913667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:40.914519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:40.914932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:40.954786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-376034a1-ac52-4899-a643-91191ff99c7a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054237 Jun 29 10:18:40.955904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 643/1205] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:41.968052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:41.968988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:41.978263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:41.978746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:41.979518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:41.980143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:42.024189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c3eac5f7-3b13-44d8-b4f7-493703553371 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060464 Jun 29 10:18:42.024787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 563/1206] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:43.037463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:43.043079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:43.045620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:43.049495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:43.049495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:43.049495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:43.079120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bcdf132d-24d1-4299-a2cc-b028120a6302 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Jun 29 10:18:43.079683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 644/1207] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:44.091135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:44.092141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:44.100074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:44.100533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:44.101316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:44.101757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:44.139133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-88ee04b8-acd8-465d-981d-eb798ce0ef96 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051875 Jun 29 10:18:44.140190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 564/1208] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:45.151755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:45.152814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:45.155271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:18:45.161799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:45.161799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:45.167718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:45.167718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:45.198733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0a303e16-eaf6-4306-a525-42a1d2ca3d8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051010 Jun 29 10:18:45.199313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 645/1209] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:46.211682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:46.212658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:46.221007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:46.221721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:46.222736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:46.223452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:46.257617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2017f44a-270a-4045-9116-b296b7c557f1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050668 Jun 29 10:18:46.258212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 565/1210] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:47.272305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:47.273259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:47.279829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:47.280277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:47.281051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:47.281486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:47.324248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-05076f7a-2e73-4b35-97b4-a8ef03c7d142 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057408 Jun 29 10:18:47.324813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 646/1211] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:48.336631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:48.338229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:48.345230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:48.345682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:48.346453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:48.347081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:48.378845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfd62815-d1da-4816-8e23-e366cab7daea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Jun 29 10:18:48.379500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 566/1212] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:49.390762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:49.391630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:49.398990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:49.399441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:49.400263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:49.400681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:49.436267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-643eaabc-c4fa-4077-8465-e7d2b3aeafda tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049692 Jun 29 10:18:49.437325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 647/1213] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:50.449900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:50.451017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:50.458709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:50.459155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:50.459936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:50.460368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:50.491127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c03723d5-b0ff-485d-a5e9-8a089f769836 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045859 Jun 29 10:18:50.491725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 567/1214] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:51.504361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:51.505752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:51.512947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:51.513392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:51.514322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:51.514605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:51.551692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e5844461-cd57-48f3-8f6b-fab3e69aed80 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052255 Jun 29 10:18:51.552282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 648/1215] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:52.563226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:52.564165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:52.571831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:52.572285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:52.573054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:52.573497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:52.604777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6adb806b-fa04-4ff0-8347-13306239ace6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Jun 29 10:18:52.605370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 568/1216] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:53.617684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:53.618686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:53.625062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:53.625687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:53.626902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:53.627609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:53.660266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e85d9bce-d765-4c1b-82ad-90201b62c0d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Jun 29 10:18:53.660852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 649/1217] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:54.672568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:54.673485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:54.681194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:54.681645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:54.682400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:54.682866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:54.716375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-088d2827-a356-4768-b27a-a1886a3a4bfb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047714 Jun 29 10:18:54.716888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 569/1218] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:55.729882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:55.731036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:55.740400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:55.740857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:55.741635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:55.742079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:55.773111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dbdc8e02-bca9-4a6c-9819-f7e313d0bad6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048827 Jun 29 10:18:55.773597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 650/1219] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:56.789731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:56.790827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:56.798206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:56.798689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:56.799733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:56.800182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:56.832485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a84792e6-a47b-4e65-bb52-5eef42941466 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Jun 29 10:18:56.833273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 570/1220] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:57.844214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:57.845140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:57.852714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:57.853159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:57.853925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:57.854356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:57.885181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93ba91f1-1500-45b1-bfa5-a6197f8e6434 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Jun 29 10:18:57.885731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 651/1221] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:58.901246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:58.902507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:58.911143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:58.911590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:58.912350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:58.912782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:58.944401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d5ac294-232a-4934-820a-a13ee5b0b2f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049811 Jun 29 10:18:58.945556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 571/1222] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:18:59.960979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:18:59.961986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:18:59.971099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:59.971685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:18:59.972559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:18:59.973086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:00.006706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9332f6d4-ac0d-4a46-968e-5a20d5f64732 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051768 Jun 29 10:19:00.007269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 652/1223] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:18:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:01.021791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:01.022774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:01.029946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:01.030602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:01.031627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:01.032307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:01.066845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ecf4e84-7bc6-43d6-a392-c7352846eb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051283 Jun 29 10:19:01.067388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 572/1224] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:02.082134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:02.083223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:02.090222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:02.090702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:02.091463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:02.091899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:02.122422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-62f88e9e-8b9e-4eb9-82e1-b547c8196f32 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Jun 29 10:19:02.123032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 653/1225] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:03.135108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:03.136059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:03.143108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:03.143552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:03.144632 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:03.145156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:03.176390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-82626ede-0de2-441e-b955-75dcb0a4ef58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Jun 29 10:19:03.177325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 573/1226] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:03.732378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:19:03.732942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:19:04.191872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:04.192847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:04.200290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:04.200748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:04.201524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:04.201975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:04.231952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f8ff944e-8a05-4f23-a8f9-0103b35844d0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Jun 29 10:19:04.232823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 654/1227] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:05.244275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:05.245204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:05.247579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:05.253523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:05.253969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:05.254775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:05.255213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:05.290598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de78a0c4-5d38-47b1-b5c4-439c52bb5756 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050357 Jun 29 10:19:05.291185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 574/1228] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:06.303376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:06.304335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:06.312424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:06.312906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:06.313771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:06.314204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:06.346877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-30edb474-fa49-435e-816b-b0c3e05552e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048023 Jun 29 10:19:06.347456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 655/1229] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:07.361305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:07.362462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:07.369821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:07.370275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:07.371075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:07.371508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:07.403134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3835aeb7-5a11-4b00-9ba8-514b4aa06bf9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047767 Jun 29 10:19:07.403662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 575/1230] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:08.418217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:08.419258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:08.428959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:08.429560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:08.430631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:08.431250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:08.465124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-887b7c4d-8c79-4647-a1c8-446e0b355cc9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052963 Jun 29 10:19:08.465686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 656/1231] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:09.477931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:09.478905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:09.485988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:09.486435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:09.487237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:09.487672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:09.526985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad296e43-0198-4bb7-956f-2ced27c7970b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052944 Jun 29 10:19:09.527547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 576/1232] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:10.539146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:10.540074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:10.547006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:10.547450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:10.548212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:10.548642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:10.551007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=90 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:10.579736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e4a77616-5429-49d0-a529-84a1e7f30f95 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Jun 29 10:19:10.580311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 657/1233] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:11.592266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:11.593192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:11.600211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:11.600656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:11.601415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:11.601848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:11.604243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=90 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:11.635880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8708531b-cfbf-47ef-a9a6-4253792c7ffd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047261 Jun 29 10:19:11.636576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 577/1234] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:12.648311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:12.649247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:12.656772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:12.657238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:12.657987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:12.658416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:12.688948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2f7de64e-5671-4268-9c7a-f33316d9f388 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Jun 29 10:19:12.689498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 658/1235] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:13.701851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:13.702801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:13.710590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:13.711041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:13.711794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:13.712490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:13.745485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e18a0602-75bd-4e06-b6bc-ef66e65c4728 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 Jun 29 10:19:13.746496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 578/1236] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:14.759214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:14.760152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:14.767110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:14.767557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:14.768322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:14.768751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:14.799675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7ccddb2-b247-4b7f-9475-9a45a7020de1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Jun 29 10:19:14.800227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 659/1237] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:15.811445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:15.812379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:15.820066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:15.820528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:15.821326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:15.821765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:15.853407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9453d8b8-bc8d-41a7-82ca-dd0a45a6b34e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Jun 29 10:19:15.853969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 579/1238] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:16.868288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:16.869544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:16.872543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=30 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:16.879739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:16.880328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:16.881679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:16.882277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:16.912564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0385ab38-c5aa-4bf6-a64f-a5faaf83929b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049722 Jun 29 10:19:16.913394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 660/1239] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:17.925339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:17.926258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:17.933966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:17.934412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:17.935198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:17.935720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:17.978588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-560f4a4e-78e3-4d9b-a1e0-52ac2dab0a49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056851 Jun 29 10:19:17.979345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 580/1240] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:18.993795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:18.994767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:19.001651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:19.002104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:19.002902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:19.003336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:19.033190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e5b4dfc8-03f7-434e-b427-ad18c102cfa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Jun 29 10:19:19.033739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 661/1241] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:20.049002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:20.050239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:20.058151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:20.058822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:20.059888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:20.060364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:20.092480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4467270f-ac6a-4e8a-b795-30a5eed57687 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049532 Jun 29 10:19:20.093035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 581/1242] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:21.106953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:21.108123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:21.118000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:21.118459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:21.119257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:21.119689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:21.153715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7f9b1c6c-647c-41f6-a78e-3ff83b687bea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053125 Jun 29 10:19:21.154439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 662/1243] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:22.166922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:22.167877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:22.174498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:22.174989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:22.175752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:22.176179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:22.212212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4eddd73-da59-429e-9407-6c4a83fcb733 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049986 Jun 29 10:19:22.213388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 582/1244] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:23.224990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:23.225921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:23.232822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:23.233263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:23.234022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:23.234450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:23.264446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-85601f0f-e157-4fb7-a538-1be2415f0385 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jun 29 10:19:23.264986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 663/1245] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:24.277623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:24.278591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:24.285584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:24.286027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:24.286825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:24.287257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:24.319190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25359d1e-d34c-48f5-886e-5287bb9e86b1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 Jun 29 10:19:24.320060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 583/1246] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:25.340823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:25.341712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:25.349477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:25.349920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:25.350936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:25.351514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:25.384721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7c06a4d8-5a31-4acd-a6f9-88f1aa0149af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048268 Jun 29 10:19:25.385932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 664/1247] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:26.398493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:26.399483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:26.406599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:26.407076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:26.407842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:26.408296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:26.438385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cddd8675-4849-4ded-8abf-985d8c25fd9e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Jun 29 10:19:26.438992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 584/1248] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:26.759020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:19:26.759401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:19:27.452753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:27.453685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:27.460692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:27.461148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:27.461903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:27.462336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:27.492404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a9fc326-2d5e-43f6-a09e-7a15bf12f9ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Jun 29 10:19:27.492969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 665/1249] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:28.507466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:28.508994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:28.517196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:28.517638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:28.518396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:28.518862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:28.556127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d27f2304-0c63-4c20-a727-9591a3e1286f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054549 Jun 29 10:19:28.556930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 585/1250] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:29.569708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:29.570681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:29.577746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:29.578225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:29.579018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:29.579485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:29.616734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2faf50e3-89be-41b3-a115-97e40f8ab0ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051379 Jun 29 10:19:29.617288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 666/1251] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:30.629052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:30.629891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:30.636616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:30.637186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:30.638108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:30.638545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:30.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02749ee5-e90c-4da9-9aa6-5ba1521559ec tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Jun 29 10:19:30.668766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 586/1252] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:31.682741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:31.684125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:31.691082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:31.691533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:31.692290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:31.692718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:31.724199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-829a6979-e929-481e-bf11-49f48b6076aa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Jun 29 10:19:31.724750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 667/1253] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:32.736589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:32.737520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:32.744469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:32.744936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:32.745695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:32.746146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:32.777817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c42877db-5c19-4ff9-a22c-cc79ff1d0b28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Jun 29 10:19:32.778587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 587/1254] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:33.791637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:33.792564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:33.798916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:33.799373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:33.800816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:33.800816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:33.833991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-820098c9-7f09-4bb3-bc79-a059a5359fa7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046576 Jun 29 10:19:33.834784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 668/1255] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:34.848463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:34.849394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:34.856414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:34.856895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:34.857657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:34.858097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:34.888123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5485324a-7b8d-40ea-8826-4902614752f7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043659 Jun 29 10:19:34.888680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 588/1256] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:35.903421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:35.904259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:35.911693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:35.912141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:35.912900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:35.913338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:35.943779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-78a19fe7-bc82-4955-8919-f5dfb5b93e0f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Jun 29 10:19:35.944693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 669/1257] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:36.958526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:36.959716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:36.963197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=30 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:36.969519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:36.969984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:36.970789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:36.971220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:37.002398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f0ecd4d3-1299-40db-a527-2ca4059a4ab1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049762 Jun 29 10:19:37.003000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 589/1258] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:38.087703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:38.088620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:38.095449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:38.095883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:38.096649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:38.097075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:38.129259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3df2e268-6eb7-4a5b-b62e-bdfd63ad797c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119277 Jun 29 10:19:38.129812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 670/1259] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:39.145309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:39.146144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:39.154149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:39.154581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:39.155382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:39.155808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:39.186923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8dc2c296-6974-4451-8f62-6dbafc32cb5a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Jun 29 10:19:39.187453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 590/1260] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:19:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:19:40.028012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:40.028575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:40.035264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.035716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.036482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.036909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.062941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:19:40.148110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ae3a6abf-8f53-4d67-88f5-b321d8d0cc21 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 204 len: 0 microversion: 2.1 time: 0.123555 Jun 29 10:19:40.148787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 671/1261] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:19:40 2022] DELETE /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:19:40.157875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:40.158488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:40.165219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.165676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.166429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.167210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.199151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:19:40.200793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:40.207430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.207886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.209458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.210127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.212666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:40.301793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0b92d5d9-d36f-4413-91eb-bc97f1979c24 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/action" status: 200 len: 118491 microversion: 2.1 time: 0.107133 Jun 29 10:19:40.302676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 672/1262] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:19:40 2022] POST /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02/action => generated 118491 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:40.362907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:40.372419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0bbac1e4-02ec-4b42-ab21-9d6bda115885 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.218745 Jun 29 10:19:40.373093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 591/1263] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:40.815233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:40.815827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:40.823682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.824158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.824930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.825398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.850723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:19:40.936308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-32a47164-d2c7-48d4-afea-d357ffc3a1d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 204 len: 0 microversion: 2.1 time: 0.125047 Jun 29 10:19:40.937041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 673/1264] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:19:40 2022] DELETE /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:19:40.946018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:40.946670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:40.953694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.954148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:40.954946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:40.955382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:41.091235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:41.099450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b818c752-93c5-4229-bde7-81442b2a3ce9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157926 Jun 29 10:19:41.100014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 592/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:41.390397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:41.391170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:41.406035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:41.406491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:41.407288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:41.407728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:41.605065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:41.617918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7b892239-2539-4642-b04b-35e9ec788a34 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.231936 Jun 29 10:19:41.618867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 674/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:41 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:41.995307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:41.995840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:42.003007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.003448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.004200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.004639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.007198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=96 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:42.032491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:19:42.116384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:42.117809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:42.124101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba6366a1-d1ad-4bbf-b523-f5aa8365e52b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 204 len: 0 microversion: 2.20 time: 0.132408 Jun 29 10:19:42.125012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 593/1267] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 10:19:41 2022] DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 10:19:42.125318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.125836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.126652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.127090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.133861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:42.134556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:42.141228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.141671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.142443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.142894 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.263515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:42.271990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8422e165-86c8-4c9e-8a4a-f3b50873e705 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159502 Jun 29 10:19:42.272590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 675/1268] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:42 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:42.283370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:42.291952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:42.293420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:42.294611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7353698e-5de9-4733-8e2c-5e68fe92f73c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1802 microversion: 2.20 time: 0.165352 Jun 29 10:19:42.295177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 594/1269] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:19:42.637268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:42.637880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:42.646684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.647139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.647976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:42.648408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:42.737028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a83cde4a-f8a3-4928-ba36-a6790f9d9203 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] Calling method '.version_select at 0x7f3870384430>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:42.740408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a83cde4a-f8a3-4928-ba36-a6790f9d9203 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [f1334fbf-b8ea-4f04-9387-83e410a10d4b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 10:19:42.894138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:42.903228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a29b995-6655-41a9-bedc-312b92723d31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.269488 Jun 29 10:19:42.903697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 676/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:42 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:43.289683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:43.290305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:43.296431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.296896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.297665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.298099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.562947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:43.571704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9503ee70-824a-4475-92d6-d78d2932e6b0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.286066 Jun 29 10:19:43.572277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 677/1271] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:43 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:19:43.577158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:43.577791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:43.583793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.584353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.585132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.585560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.684500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:43.693516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:43.695410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:43.696591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-23014540-e559-4f4b-8bcb-eca133a111fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1735 microversion: 2.20 time: 0.123386 Jun 29 10:19:43.697125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 678/1272] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1735 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:43.748828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [None req-a83cde4a-f8a3-4928-ba36-a6790f9d9203 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] [f1334fbf-b8ea-4f04-9387-83e410a10d4b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48474. Jun 29 10:19:43.773288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a83cde4a-f8a3-4928-ba36-a6790f9d9203 tempest-TestVolumeBootPattern-2110480405 tempest-TestVolumeBootPattern-2110480405-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-698110575" status: 202 len: 0 microversion: 2.1 time: 1.039891 Jun 29 10:19:43.774355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 595/1273] 10.222.0.52 () {58 vars in 1259 bytes} [Wed Jun 29 10:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-698110575 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:19:43.930453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-f9671d80-c7e9-4a4f-9710-64b5a09abca9 req-e9bd2862-502c-4855-9bac-688556a87000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18247887-76cd-4d14-b694-3aaa572ca574", "name": "network-vif-deleted", "tag": "26888310-71e8-4aa7-9019-d6e4607dd7af"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:19:43.932386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:43.933759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:43.947759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.948219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.949302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f9671d80-c7e9-4a4f-9710-64b5a09abca9 req-e9bd2862-502c-4855-9bac-688556a87000 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.949986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-f9671d80-c7e9-4a4f-9710-64b5a09abca9 req-e9bd2862-502c-4855-9bac-688556a87000 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.950673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:43.951394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:43.969106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-f9671d80-c7e9-4a4f-9710-64b5a09abca9 req-e9bd2862-502c-4855-9bac-688556a87000 service nova] Creating event network-vif-deleted:26888310-71e8-4aa7-9019-d6e4607dd7af for instance 18247887-76cd-4d14-b694-3aaa572ca574 on hv-cinder-76810 Jun 29 10:19:43.974695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-f9671d80-c7e9-4a4f-9710-64b5a09abca9 req-e9bd2862-502c-4855-9bac-688556a87000 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188306 Jun 29 10:19:43.975574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 679/1274] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:19:44.108697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:44.116743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f6470f8f-a588-4211-85e5-e6554a08e321 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.200134 Jun 29 10:19:44.118610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 596/1275] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:44.590593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:44.592009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:44.599253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:44.599785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:44.600572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:44.601005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:44.714898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:44.716326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:44.722814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:44.723266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:44.724032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:44.724497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:44.791725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:44.801737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:44.803643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:44.804916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-575507e2-f6e1-4bcc-9898-8d3850e86606 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094020 Jun 29 10:19:44.806017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 597/1276] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:45.094658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:45.103652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-260489d0-1186-424b-890f-4ca4d06c688e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.517798 Jun 29 10:19:45.104213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 680/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:44 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:45.133483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:45.134097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:45.141653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:45.142095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:45.142897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:45.143328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:45.280179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:45.288624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13fba2be-bf73-438b-bf82-0c43c68f3d04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159026 Jun 29 10:19:45.289164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 598/1278] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:45.824087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:45.824710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:45.834373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:45.834373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:45.834373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:45.834373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:45.992704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:46.002036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:46.003871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:46.005062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-12386416-70e4-4403-844e-730e621ce1ea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.185053 Jun 29 10:19:46.005585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 681/1279] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:46.121291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:46.122946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:46.130205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:46.130685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:46.131559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:46.131909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:46.305754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:46.306375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:46.315015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:46.315887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:46.316887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:46.317522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:46.320340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:46.330918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a626705-4ed1-475d-bf0b-c0b65d56f08e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.213547 Jun 29 10:19:46.340348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 599/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:46 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:46.634708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:46.648447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7a997deb-9523-4ade-884e-d425a364178f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.346230 Jun 29 10:19:46.649413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 682/1281] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:19:47.025375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:47.025988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:47.046284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:47.047165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:47.048995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:47.049638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:47.119945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:47.129054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:47.130622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:47.131822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df4d0e5c-c3b5-4a5d-a7ec-ca551649c984 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.110451 Jun 29 10:19:47.132389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 600/1282] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:47.349230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:47.350034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:47.352636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:47.359303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:47.360063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:47.361014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:47.361614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:47.501204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:47.509624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-47d4cdc1-a384-457c-b501-fbe20ff8012b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164413 Jun 29 10:19:47.510201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 683/1283] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:47 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:47.666522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:47.667077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:47.674298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:47.674777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:47.675721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:47.676332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:47.837929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:47.847010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a4f723c-a659-4d97-b45e-83a6daaed192 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.184207 Jun 29 10:19:47.848093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 601/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:19:48.150689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:48.151957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:48.158580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:48.159318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:48.160102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:48.160552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:48.231972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:48.240665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:48.242187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:48.243403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9b90918b-139b-41e6-8238-3a116eec3f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098042 Jun 29 10:19:48.243961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 684/1285] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:48.528315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:48.528911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:48.535182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:48.535605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:48.536373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:48.536828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:48.805380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:48.815050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3f24a2a1-f033-4749-b823-58f3313a33f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.290773 Jun 29 10:19:48.815634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 602/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:48 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:48.865661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:48.866283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:48.874156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:48.874458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:48.875273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:48.876237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:49.010607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:49.020287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8468c4f2-99fe-4f72-8169-07bdc63803fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.158373 Jun 29 10:19:49.020879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 685/1287] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:49.261794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:49.262506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:49.269211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:49.269660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:49.270437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:49.271144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:49.348172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:49.357429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:49.359296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:49.360641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-293c81b8-1a17-4eaf-b1db-d9d55bbeffa2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103018 Jun 29 10:19:49.361576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 603/1288] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:49.833166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:49.833966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:49.840945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:49.841789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:49.842884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:49.843456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:50.005711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:50.014548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c56ea016-f998-465f-a05f-1e1de440f916 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185446 Jun 29 10:19:50.015272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 686/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:49 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:50.037603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:50.038804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:50.045749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:50.046632 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:50.047590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:50.048184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:50.261544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:50.272095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-55a0f3f9-74d8-4cdb-bb10-73666e7f7e59 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.238492 Jun 29 10:19:50.273072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 604/1290] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:50.378364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:50.379036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:50.385242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:50.385694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:50.386461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:50.387107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:50.465662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:50.474460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:50.476004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:50.477159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8df6afa9-9274-45b1-be9c-b16c12a1dbcf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102986 Jun 29 10:19:50.487889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 687/1291] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:51.032379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:51.032996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:51.039694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:51.040348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:51.041155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:51.041594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:51.233682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:51.241887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-54f6fa34-f2fb-4745-8665-eab9f4a0427d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.213453 Jun 29 10:19:51.242806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 605/1292] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:51.290616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:51.291811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:51.299641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:51.300096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:51.300832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:51.301288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:51.304080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:51.496011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:51.496775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:51.503649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:51.504494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:51.505268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:51.505863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:51.539961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:51.551536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6be00b12-d4a6-4110-bb80-f234eca96a8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.264396 Jun 29 10:19:51.552228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 688/1293] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:51 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:51.630388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:51.646616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:51.649260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:51.650884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-236208f5-80b8-4d31-8b47-6a86846f1cb1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.158952 Jun 29 10:19:51.651884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 606/1294] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:52.259582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:52.260190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:52.267420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:52.267870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:52.268636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:52.269066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:52.412822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:52.422744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7811144d-d27a-4d50-842f-27fa59a0aa25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166955 Jun 29 10:19:52.423585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 689/1295] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:52 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:52.570061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:52.570785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:52.577809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:52.578393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:52.579279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:52.579777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:52.671231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:52.672534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:52.681937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:52.683015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:52.684211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:52.684853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:52.730472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:52.743129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a704d510-3b46-4a1c-bd1a-2b45837d2929 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.177052 Jun 29 10:19:52.743663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 607/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:52.765869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:52.774587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:52.776381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:52.777923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b84b9379-66ae-45f7-97be-8767d613980c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.111426 Jun 29 10:19:52.779155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 690/1297] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:19:53.440810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:53.441773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:53.450778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:53.451301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:53.452161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:53.452606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:53.601584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:53.610423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8af36732-c0aa-4569-8097-a836ce855776 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173718 Jun 29 10:19:53.611029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 608/1298] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:53.761234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:53.761784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:53.769134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:53.769608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:53.770388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:53.770883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:53.798237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:53.798759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:53.806099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:53.806705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:53.807547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:53.808132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:53.811407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:19:53.876024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:53.885335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:53.887006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:53.888941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-25315782-9c3d-4dde-8f05-fb88a24e8992 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095467 Jun 29 10:19:53.889504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 609/1299] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:19:53.913654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:53.922545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7c810eaf-db4c-454e-ae64-78c632b680cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165418 Jun 29 10:19:53.923142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 691/1300] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:54.628435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:54.629094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:54.635802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:54.636263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:54.637119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:54.637587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:54.779544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:54.788015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff4a44d0-3d79-4bfb-a57c-5215524177c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163611 Jun 29 10:19:54.788630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 610/1301] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:54 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:54.909332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:54.909884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:54.917105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:54.917559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:54.918379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:54.918857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:54.939982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:54.940602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:54.947263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:54.947721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:54.948717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:54.949257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:54.989609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:54.999017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:55.000785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:55.001945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f28e1caa-e442-4fba-9ee4-a122e435094e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096731 Jun 29 10:19:55.002471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 692/1302] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:55.091262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:55.100621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2ab5cf5e-8e73-4aec-9552-530e1f447638 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164464 Jun 29 10:19:55.101275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 611/1303] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:54 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:55.807140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:55.807755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:55.814408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:55.814883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:55.815753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:55.816113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:55.951135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:55.959989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9691554e-25e1-4ff4-bfe9-385795b47ef3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156768 Jun 29 10:19:55.960687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 693/1304] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:55 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:56.020505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:56.021143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:56.028561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:56.029007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:56.029751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:56.030182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:56.094356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:56.103050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:56.104538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:56.105910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1da39987-58d2-45d9-8487-35848d7f12e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089330 Jun 29 10:19:56.106466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 612/1305] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:56.129731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:56.130318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:56.136970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:56.137558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:56.138421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:56.138893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:56.280656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:56.288874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df693f3b-5ae6-49c0-9331-3b17a87bcd30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163105 Jun 29 10:19:56.289453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 694/1306] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:56 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:56.977468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:56.978073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:56.984814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:56.985265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:56.985996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:56.986418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:57.127246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:57.127620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:57.129154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:57.136324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:57.137062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:57.138169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f8f00baa-0e0f-41bf-be99-adf36ecb026a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164521 Jun 29 10:19:57.138502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:57.138802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 613/1307] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:57.138960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:57.209033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:57.218230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:57.219783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:57.220943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-43161d9b-5aa5-4ed1-aa42-70d5d057fe60 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099005 Jun 29 10:19:57.221505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 695/1308] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:19:57.306960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:57.307506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:57.314461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:57.314941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:57.315707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:57.316146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:57.459751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:57.471723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0d387ae-b2ef-4299-84c2-549c9d58ea6b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168881 Jun 29 10:19:57.472314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 614/1309] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:57 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:58.160468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:58.161119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:58.170319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:58.170801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:58.171583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:58.172005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:58.239564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:58.240183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:58.247549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:58.247996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:58.248765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:58.249187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:58.312081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:58.317200 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:58.321038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:58.322511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:58.323683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3815fa9d-c9e8-4130-b30e-efd3a788b83d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088341 Jun 29 10:19:58.324361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 615/1310] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:19:58.325651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ec924a19-765e-422d-bd99-dc3410a57ca8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170311 Jun 29 10:19:58.326223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 696/1311] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:58 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:58.489056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:58.489667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:58.496335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:58.497012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:58.497754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:58.498182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:58.649863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:58.658940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9503ec04-92cb-46c1-a011-25f810374e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173742 Jun 29 10:19:58.659510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 616/1312] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:59.342979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:59.343648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:59.344803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:59.345868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:59.352351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:59.352853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:59.353652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:59.354181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:59.355249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:59.355736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:59.356728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:59.357143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:59.421029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:59.430693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:59.432370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:59.433571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70efcf03-f546-43cb-9ff8-00529c40d307 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094711 Jun 29 10:19:59.434179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 697/1313] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:19:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:19:59.496909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:59.505423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1680d3bc-bf98-4b68-a93e-8bd8b70fde81 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166459 Jun 29 10:19:59.505995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 617/1314] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:19:59.676633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:19:59.677145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:19:59.684338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:59.684783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:59.685545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:19:59.685991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:19:59.822848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:19:59.831700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4812e06a-f7d2-4f68-9b14-3c0fd86b4425 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159112 Jun 29 10:19:59.832283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 698/1315] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:19:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:00.454438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:00.455519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:00.464155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:00.464600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:00.465446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:00.465945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:00.523351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:00.524069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:00.532137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:00.532690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:00.533547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:00.534082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:00.538020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:00.547921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:00.549462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:00.550706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1549031e-3b3f-4390-a9f3-ea07c92c9e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102367 Jun 29 10:20:00.551955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 618/1316] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:00.691354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:00.706151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a0b0f3bb-45ab-4aa3-aadd-1c9ec54dea14 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.184714 Jun 29 10:20:00.706727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 699/1317] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:00.849597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:00.850392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:00.857500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:00.857942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:00.858740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:00.859139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:01.011316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:01.027640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76de1818-3f13-4d0a-bbd9-f1761020a3f4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.181802 Jun 29 10:20:01.029098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 619/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:00 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:01.570198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:01.570787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:01.577967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:01.578424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:01.579230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:01.579663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:01.648952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:01.659560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:01.661052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:01.662211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-193afed4-d49a-4227-abcf-acb4bc65436b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096452 Jun 29 10:20:01.662827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 700/1319] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:01.724633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:01.725259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:01.733290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:01.733801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:01.734691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:01.735212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:01.878593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:01.887046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6e13f655-559b-48a8-b9f3-66b982aa2929 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166889 Jun 29 10:20:01.887586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 620/1320] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:01 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:02.046156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:02.046808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:02.053443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:02.053878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:02.054678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:02.055126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:02.200316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:02.212201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7cb54992-b36d-4b12-a5ad-897315e6dc18 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170432 Jun 29 10:20:02.213011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 701/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:02 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:02.683771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:02.684503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:02.695120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:02.695762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:02.696787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:02.697408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:02.762987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:02.771771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:02.773246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:02.774365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63e42851-46c4-4344-a5fe-2817dcaf73ac tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096939 Jun 29 10:20:02.774965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 621/1322] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:02.905647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:02.906425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:02.913580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:02.914022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:02.914847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:02.915274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:03.055903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:03.064320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-07e90244-b871-4aa8-884a-0f9c4a16a4f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162663 Jun 29 10:20:03.064897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 702/1323] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:03.230111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:03.230753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:03.237513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:03.237965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:03.238751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:03.239180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:03.373007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:03.381654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6872270-b013-448e-b766-77fbd085876f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.155446 Jun 29 10:20:03.382224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 622/1324] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:03 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:03.795006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:03.796067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:03.803204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:03.803610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:03.804515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:03.805264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:03.874525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:03.883420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:03.884903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:03.886046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7bdf5f96-a5a6-4092-85ec-13db1ba296ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097170 Jun 29 10:20:03.886972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 703/1325] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:04.082393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:04.082988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:04.089900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:04.090347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:04.091162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:04.091592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:04.224062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:04.232609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9d22bc4-b202-4c22-86f4-411503ad2bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.154266 Jun 29 10:20:04.233207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 623/1326] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:04 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:04.402648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:04.403592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:04.411779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:04.412234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:04.413014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:04.413461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:04.568302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:04.570910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:04.578930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8857e445-ad4b-44e6-81ef-7ca8c61e2502 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.181964 Jun 29 10:20:04.579515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 704/1327] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:04 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:04.904577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:04.905116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:04.912271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:04.912721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:04.913476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:04.913912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:04.985476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:04.994268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:04.995785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:04.996921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7a2046f0-4f77-42b3-8e12-e8280763cb32 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096543 Jun 29 10:20:04.997479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 624/1328] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:05.258236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:05.259296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:05.266163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:05.266774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:05.267868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:05.268521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:05.406942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:05.415587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-38159650-90dc-40e0-a3cb-b7421ecd6eab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163138 Jun 29 10:20:05.416132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 705/1329] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:05 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:05.597447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:05.598031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:05.604994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:05.605450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:05.606198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:05.606660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:05.912742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:05.914982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:05.922175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-746e3025-9f8e-4a42-b4ad-3a7ee96b79d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.329197 Jun 29 10:20:05.923014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 625/1330] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:06.015647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:06.016924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:06.023577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:06.024021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:06.024779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:06.025209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:06.093436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:06.102597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:06.104112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:06.105262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63a77641-1044-4a18-b08c-1dccc4790636 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093563 Jun 29 10:20:06.105822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 706/1331] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:06.434238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:06.434907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:06.442514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:06.443041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:06.444260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:06.444736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:06.579753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:06.588284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-96fa7509-3dda-40c0-869f-3fe3e0d55d12 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158361 Jun 29 10:20:06.588856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 626/1332] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:06 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:06.940166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:06.940769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:06.948317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:06.948767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:06.949533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:06.949973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:07.090387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:07.098935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-874a9c2e-9744-45ff-9e7c-f98a184394be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162740 Jun 29 10:20:07.099590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 707/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:07.123817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:07.124422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:07.126934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:07.132588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:07.132974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:07.133743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:07.134176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:07.202357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:07.211574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:07.213044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:07.214192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e1fb04de-6e13-497c-a4f6-435c983cf852 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094334 Jun 29 10:20:07.214762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 627/1334] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:07.606436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:07.607088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:07.615283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:07.615716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:07.616505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:07.616917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:07.768653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:07.780616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4096a1d8-0cb1-47e4-863b-776dbc9c4406 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178373 Jun 29 10:20:07.781301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 708/1335] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:07 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:08.123116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:08.123789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:08.131153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:08.131767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:08.132378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:08.132809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:08.236351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:08.236962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:08.244038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:08.244495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:08.245243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:08.246007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:08.276277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:08.285477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc8bd365-6c20-469e-b8ad-e58df854e29f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168577 Jun 29 10:20:08.286286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 628/1336] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:08.311398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:08.320626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:08.322162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:08.323350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7dc0caaa-bc4b-41d2-9ad5-a345bda701c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090899 Jun 29 10:20:08.323881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 709/1337] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:08.799644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:08.800250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:08.806711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:08.807138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:08.807918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:08.808353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:08.949670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:08.958231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d52a0fa1-50d1-4261-ab9c-27be5c328906 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163081 Jun 29 10:20:08.958821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 629/1338] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:08 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:09.303217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:09.303832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:09.310949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:09.311329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:09.312081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:09.312489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:09.346397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:09.347035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:09.354493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:09.355050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:09.355823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:09.356256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:09.418795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:09.428222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:09.429696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:09.430873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-108c598f-800d-4f7c-a93a-08f1a090b4da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090889 Jun 29 10:20:09.431423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 630/1339] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:09.448624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:09.457658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b53eaf11-69a5-4f7f-ae37-fd29b40ab943 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.158453 Jun 29 10:20:09.458209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 710/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:09 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:09.980604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:09.981363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:09.989752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:09.990197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:09.990982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:09.991421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:10.141524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:10.150323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02520a34-4035-4e67-aa05-cff82dad45e4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173896 Jun 29 10:20:10.150969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 631/1341] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:10.453252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:10.453848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:10.462604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:10.463079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:10.463838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:10.464273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:10.475547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:10.476150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:10.482977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:10.483426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:10.484201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:10.484628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:10.528670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:10.537796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:10.539333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:10.540489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-842a7c06-7142-44cd-9068-5023f19136a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093554 Jun 29 10:20:10.541051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 711/1342] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:10.619588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:10.627882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1cf9972-7f4a-4619-aac7-a662eb38bfef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.156291 Jun 29 10:20:10.628443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 632/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:10 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:11.173627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:11.174259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:11.181306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:11.181813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:11.182992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:11.183583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:11.328825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:11.341110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fbd27ad6-0bbe-4735-8883-8b389a297280 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172808 Jun 29 10:20:11.341978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 712/1344] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:11 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:11.561004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:11.561619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:11.569887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:11.570330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:11.571217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:11.571636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:11.642747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:11.645406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:11.645997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:11.651775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:11.652750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:11.653201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:11.653316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:11.653980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:11.654418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:11.654549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4703ee1-6e36-4195-a128-a11154985f87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097723 Jun 29 10:20:11.655030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 633/1345] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:11.787258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:11.798213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-36b3cc97-f603-4a9a-9574-7259bc34c8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.156713 Jun 29 10:20:11.798960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 713/1346] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:12.360018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:12.361349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:12.367992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:12.368436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:12.369199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:12.369628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:12.507432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:12.518218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce54480d-b6b7-4188-8ce7-e19f46d127af tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162163 Jun 29 10:20:12.518819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 634/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:12 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:12.676628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:12.677233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:12.686854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:12.687446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:12.688723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:12.688940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:12.762773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:12.772596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:12.774083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:12.775346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-008eb6be-f395-4b4d-a326-431a3d2e4940 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.104840 Jun 29 10:20:12.775900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 714/1348] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:12.821690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:12.822289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:12.830137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:12.830548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:12.831374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:12.831800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:12.970051 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:12.978743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a13264af-b46a-415e-9a76-0973a107a0da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161258 Jun 29 10:20:12.979321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 635/1349] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:12 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:13.536814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:13.537422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:13.543901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:13.544361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:13.545147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:13.545575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:13.701403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:13.710915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7700ca2f-1b83-4df9-acec-99bbf71ca22d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178117 Jun 29 10:20:13.711491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 715/1350] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:13 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:13.800422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:13.801083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:13.807478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:13.807979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:13.808719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:13.809194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:13.881074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:13.890029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:13.892072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:13.893203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0cc684cf-a38a-477c-9073-652bd68aee5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097572 Jun 29 10:20:13.893756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 636/1351] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:13.997713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:13.998431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:14.005662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:14.006183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:14.007153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:14.007660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:14.144247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:14.154712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6f9d770a-21fa-4ef5-87b3-914fe6ee321d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161811 Jun 29 10:20:14.155310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 716/1352] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:13 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:14.729071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:14.729767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:14.737381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:14.737835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:14.738591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:14.739044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:14.884472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:14.893104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a20378a2-cd18-43cd-9a8b-0ccf0856c0d1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168312 Jun 29 10:20:14.893688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 637/1353] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:14 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:14.916799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:14.917509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:14.924640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:14.925097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:14.925874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:14.926312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:14.993411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:15.003176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:15.004695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:15.005838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-77afde50-4367-4c90-9735-b6d458f5aca1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093030 Jun 29 10:20:15.006388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 717/1354] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:15.172709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:15.173516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:15.180290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:15.180728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:15.181506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:15.181975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:15.328502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:15.338251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fc95afe8-f4c4-4f4f-8900-1cd570bb90da tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169668 Jun 29 10:20:15.338836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 638/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:15 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:15.912745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:15.913376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:15.921573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:15.922220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:15.922943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:15.923387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:16.026529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:16.027137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:16.034449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:16.034911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:16.035676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:16.036111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:16.077301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:16.086074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-93e5e431-8da2-47d8-8f63-a0bea204399a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.177741 Jun 29 10:20:16.087008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 718/1356] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:15 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:16.103936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:16.112661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:16.114198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:16.115391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b13a0eb-b1b7-44f4-a81d-6c434937e896 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094883 Jun 29 10:20:16.115956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 639/1357] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:16.360446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:16.361249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:16.367773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:16.368229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:16.368989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:16.369420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:16.503245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:16.511932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b15da09a-e128-436d-bd8f-f215e6592ad5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.155376 Jun 29 10:20:16.512479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 719/1358] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:17.106219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:17.106825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:17.117010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:17.117606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:17.118700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:17.119184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:17.133527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:17.134231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:17.141465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:17.143032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:17.143811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:17.144243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:17.209575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:17.218309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:17.220360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:17.221237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9c2801bf-5cf3-4ae3-8b7d-3fd93756c4f7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091803 Jun 29 10:20:17.221807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 720/1359] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:17.255766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:17.263996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e2d2a80-928b-45e8-be62-7876fca4d2ba tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163446 Jun 29 10:20:17.264559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 640/1360] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:17 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:17.529831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:17.530445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:17.533699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=76 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:17.539156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:17.539598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:17.540366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:17.540792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:17.556527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:17.691264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:17.699944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9fc88d0b-0421-46eb-b59a-3154c6bc990c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.174281 Jun 29 10:20:17.700508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 721/1361] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:17.818884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:20:17.819114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:20:18.240254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:18.240964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:18.247994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:18.248445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:18.249205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:18.249640 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:18.282054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:18.283272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:18.290297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:18.290790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:18.291559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:18.291986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:18.311813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:18.321048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:18.322539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:18.323712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5689e6eb-501e-473e-bd17-27199ce5541d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087511 Jun 29 10:20:18.324277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 641/1362] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:18.429123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:18.438023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-22c2f29e-b67e-4c88-8ca6-fb5857ad8db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160167 Jun 29 10:20:18.439135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 722/1363] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:18 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:18.720826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:18.721420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:18.728209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:18.728657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:18.729416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:18.729843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:18.744694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:18.877249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:18.885613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9b59165-d1d8-4fb3-8fef-3aba5b82cad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170952 Jun 29 10:20:18.886149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 642/1364] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:19.342881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:19.343513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:19.350263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:19.350745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:19.351515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:19.351939 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:19.421376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:19.435123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:19.437377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:19.438949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1244a8f8-6775-4ba9-8a66-ebe7407cfa73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100427 Jun 29 10:20:19.439510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 723/1365] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:19.455781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:19.456343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:19.463493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:19.463942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:19.464701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:19.465132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:19.599311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:19.607719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1698bc48-0775-4b58-b9ac-6f985b1c70c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156045 Jun 29 10:20:19.608267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 643/1366] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:19 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:19.903470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:19.903990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:19.910931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:19.911402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:19.912170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:19.912604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:20.050711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:20.059971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1be96d99-8657-45d2-8cd9-eb8bbd6faac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160426 Jun 29 10:20:20.060800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 724/1367] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:20.298746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:20:20.298999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:20:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:20:20.458161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:20.458762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:20.465820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:20.466271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:20.467077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:20.467505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:20.540869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:20.551027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:20.552371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:20.553516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0138ad00-7bfe-4905-9f0b-5da83041aa54 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099607 Jun 29 10:20:20.554071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 644/1368] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:20.627742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:20.628341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:20.638195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:20.638836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:20.639755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:20.640291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:20.788545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:20.801472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-743a4e4f-9a9e-44db-99ab-233517461409 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179428 Jun 29 10:20:20.802064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 725/1369] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:20 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:21.078171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:21.078821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:21.085498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:21.085942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:21.086758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:21.087181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:21.229503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:21.239748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74f07932-a63e-4b93-ad72-82f525670774 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165498 Jun 29 10:20:21.240319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 645/1370] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:21.572442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:21.573058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:21.579710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:21.580164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:21.580947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:21.581372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:21.654554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:21.668007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:21.670381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:21.672183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-29930eeb-9e3a-4a9b-9cf6-2fce738a3ae4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103866 Jun 29 10:20:21.673455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 726/1371] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:21.823945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:21.824520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:21.833009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:21.833533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:21.834351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:21.834919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:21.983563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:21.992590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3ba21c8-f69f-45cb-8b57-1870b9fa28f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172695 Jun 29 10:20:21.993196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 646/1372] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:21 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:22.257553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:22.258166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:22.264699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:22.265151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:22.265918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:22.266335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:22.405588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:22.417507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-96ad2a27-c7b7-48b4-96ee-256604628aa3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163660 Jun 29 10:20:22.418249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 727/1373] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:22 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:22.692156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:22.692772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:22.699668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:22.700118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:22.700882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:22.701311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:22.767045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:22.776364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:22.777841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:22.779023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b4633bc-1412-41eb-ac03-8fd72455a8a3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091363 Jun 29 10:20:22.779575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 647/1374] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:23.013760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:23.014538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:23.022482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:23.023248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:23.024160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:23.024806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:23.167537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:23.177961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-83ba6174-1deb-49a2-b9e7-0e612a28b169 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168161 Jun 29 10:20:23.179037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 728/1375] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:23 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:23.437832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:23.438514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:23.448217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:23.448897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:23.449925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:23.450605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:23.604803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:23.616806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f5223dd9-7821-4b65-8b1a-ec8502000afc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.184310 Jun 29 10:20:23.617661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 648/1376] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:23.799594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:23.800381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:23.807861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:23.808402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:23.809413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:23.809900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:23.879316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:23.892636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:23.894145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:23.895350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-796bd3da-5762-4a0a-8302-33400b659f0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101280 Jun 29 10:20:23.895923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 729/1377] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:24.198278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:24.198944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:24.205831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:24.206280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:24.207088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:24.207518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:24.343176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:24.351474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cca2cddb-d20b-4a0e-a16a-c787384a8c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157189 Jun 29 10:20:24.352048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 649/1378] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:24 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:24.637262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:24.638024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:24.645960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:24.646413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:24.647217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:24.647655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:24.795502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:24.805373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a96ccfe1-586e-409c-88c3-cd8c6552e5cf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173569 Jun 29 10:20:24.805951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 730/1379] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:24.914064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:24.914747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:24.921612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:24.922080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:24.922889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:24.923497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:24.992040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:25.002312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:25.003849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:25.004992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2c21c924-5632-4617-909e-8d82244032cc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095054 Jun 29 10:20:25.005529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 650/1380] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:25.374203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:25.374917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:25.382613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:25.383109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:25.383956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:25.384431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:25.531384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:25.542985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2c5d7a72-7012-4657-a291-f9a73a677245 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172778 Jun 29 10:20:25.543683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 731/1381] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:25 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:25.825754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:25.826339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:25.833508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:25.834119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:25.834920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:25.835450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:25.979989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:25.991360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c61b9030-169f-4d84-a824-efe8fefecc46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170151 Jun 29 10:20:25.992120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 651/1382] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:25 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:26.028804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:26.029422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:26.037761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:26.038201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:26.039012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:26.039444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:26.108680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:26.118067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:26.119585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:26.120716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a1b4d712-ed7e-4221-a9de-bdd3c5366c51 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101161 Jun 29 10:20:26.121249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 732/1383] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:26.562016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:26.562648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:26.570053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:26.570495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:26.571286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:26.571715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:26.710745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:26.719093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2921fb5f-4bc3-4bf2-9c5d-cd822e1b124c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160983 Jun 29 10:20:26.719665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 652/1384] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:26 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:27.012397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:27.013003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:27.019828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:27.020267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:27.021026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:27.021453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:27.145020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:27.145585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:27.152715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:27.153172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:27.153948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:27.154379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:27.160999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:27.169456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-646f23e3-fa75-4bef-ba1c-d34c1883a13f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160974 Jun 29 10:20:27.169998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 733/1385] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:27.222778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:27.231526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:27.233014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:27.234166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2378110f-918b-4406-966f-473d2d9c7868 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093677 Jun 29 10:20:27.234745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 653/1386] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:27.737585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:27.738226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:27.744676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:27.745122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:27.745880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:27.746309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:27.878197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:27.890428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f2b3a3de-a89c-4a73-a805-81d3b2abdd40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156708 Jun 29 10:20:27.891117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 734/1387] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:27 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:28.189740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:28.190774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:28.199263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:28.199742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:28.200805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:28.201391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:28.253082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:28.253711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:28.260750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:28.261207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:28.261983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:28.262401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:28.327976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:28.337761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:28.339158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:28.339301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:28.340457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1cab0a7f-8bc0-4edf-95f6-9a26b5805ec4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091964 Jun 29 10:20:28.341207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 735/1388] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:28.347389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-477e1c57-b8e4-44ff-bc96-df7b73b61aad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162825 Jun 29 10:20:28.347957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 654/1389] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:28.908364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:28.908984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:28.915589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:28.916039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:28.916800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:28.917235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:29.069926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:29.081137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aa97b623-802f-4075-8f88-af88bc3f1780 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.176549 Jun 29 10:20:29.081844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 736/1390] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:28 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:29.361300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:29.362340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:29.364674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:29.365312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:29.368685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:29.369141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:29.369941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:29.370376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:29.372035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:29.372496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:29.373280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:29.373723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:29.440282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:29.450008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:29.451531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:29.452687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a1a7f31e-56f5-4508-9b8d-a11e1179b704 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095774 Jun 29 10:20:29.453236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 655/1391] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:20:29.519287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:29.531484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1063f8aa-2883-4f7a-9bf6-9a0c4b01dd5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170727 Jun 29 10:20:29.532194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 737/1392] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:29 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:20:30.099007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:30.099608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:30.106141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:30.106588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:30.107469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:30.107941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:30.254924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:30.263425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bcf6dde3-eff7-4119-b94a-4825cea227b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168585 Jun 29 10:20:30.264031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 656/1393] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:30 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:30.473999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:30.474612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:30.481983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:30.482428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:30.484276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:30.484849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:30.488812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:30.549707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:30.550457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:30.557556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:30.558003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:30.558806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:30.559235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:30.560788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:30.570884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:30.572402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:30.573607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e430bd05-451b-4bb9-b8c7-e47d1c6c3163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.104875 Jun 29 10:20:30.574183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 738/1394] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:30.698341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:30.707123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-765d32cc-f6e2-43e0-afbd-80df7a50c424 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161357 Jun 29 10:20:30.707706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 657/1395] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:31.281206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:31.281812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:31.289130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:31.289576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:31.290338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:31.290813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:31.451005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:31.460435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7a7dabfa-d25e-496e-9134-4cf2d2702319 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.183110 Jun 29 10:20:31.461017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 739/1396] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:31 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:31.596457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:31.600555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:31.607591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:31.608035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:31.608794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:31.609225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:31.671107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:31.680570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:31.682064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:31.683238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-96ce37ca-ab61-44de-babb-e11257e57689 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094548 Jun 29 10:20:31.683796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 658/1397] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:31.729520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:31.730088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:31.737696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:31.738142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:31.738940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:31.739368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:31.881730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:31.893047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-18fdd8ac-bd95-4edd-b81d-486b2befa6f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167295 Jun 29 10:20:31.893879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 740/1398] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:32.482283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:32.483054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:32.491395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:32.491974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:32.492955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:32.493520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:32.497123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:32.643291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:32.651533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4d8e1438-15a1-42b0-b937-b9cb37759e6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173317 Jun 29 10:20:32.652102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 659/1399] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:32 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:32.702190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:32.702826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:32.709703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:32.710146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:32.710958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:32.711371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:32.780278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:32.790597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:32.792055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:32.793196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-84f7a1c1-e60c-42d0-9cf3-7460d5fe7bcc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095098 Jun 29 10:20:32.793725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 741/1400] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:32.915503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:32.916257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:32.923068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:32.923524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:32.924283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:32.925204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:33.069996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:33.078312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9cb7195c-df75-4169-947f-39b7465267ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166749 Jun 29 10:20:33.078919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 660/1401] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:32 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:33.669380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:33.669995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:33.677101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:33.677591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:33.678361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:33.678959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:33.812554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:33.813194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:33.821595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:33.821955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:33.822984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:33.823474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:33.827936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:33.836337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3d44f595-a274-460f-8dc3-886201b32627 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170920 Jun 29 10:20:33.836930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 742/1402] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:33 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:33.885716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:33.894686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:33.896223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:33.897378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2b6e562-f68c-4ca7-86e5-48b2e8736de8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088976 Jun 29 10:20:33.897936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 661/1403] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:20:34.098726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:34.099340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:34.106054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:34.106504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:34.107331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:34.107747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:34.252516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:34.261635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff6b1a52-17c5-4366-9b25-aa4e5268919d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168074 Jun 29 10:20:34.262208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 743/1404] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:34.854185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:34.854842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:34.861753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:34.862208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:34.863056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:34.863534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:34.915173 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:34.915786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:34.923085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:34.923538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:34.924321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:34.924761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:34.991819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:35.001868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:35.006260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:35.007747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:35.008936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9c4e8fdd-52f6-4f49-ab6b-96700912783e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097869 Jun 29 10:20:35.009763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 744/1405] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:35.010160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-70e4b75e-3cf6-4179-a9fa-4e57cf3007d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159919 Jun 29 10:20:35.011734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 662/1406] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:34 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:35.279460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:35.279966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:35.287054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:35.287495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:35.288255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:35.288686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:35.427642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:35.439556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-16528119-ac9e-4487-97df-0b9a2067467a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163894 Jun 29 10:20:35.440391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 745/1407] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:35 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:36.027069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:36.027781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:36.028153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:36.028258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:36.034625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:36.035046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:36.035155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:36.035605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:36.035842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:36.036285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:36.036481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:36.036946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:36.101110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:36.109790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:36.111421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:36.112777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-524db431-9d57-4a2a-afb8-06bb816c1a20 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089616 Jun 29 10:20:36.113311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 663/1408] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:36.170125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:36.180490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f4840ef2-a89c-4b89-9367-f779288f4f7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157226 Jun 29 10:20:36.181091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 746/1409] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:36 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:36.458720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:36.459422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:36.466615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:36.467150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:36.467986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:36.468560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:36.611303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:36.620070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3dfa2170-bca4-4df9-b04f-68c74d4fc4bf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166083 Jun 29 10:20:36.620636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 664/1410] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:36 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:37.130993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:37.131595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:37.138685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:37.139178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:37.140106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:37.140547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:37.198669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:37.199339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:37.201787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=76 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:37.207722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:37.208172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:37.208949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:37.209380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:37.218057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:37.227453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:37.229060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:37.230300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6d1e1801-a48e-4fcb-a7be-c3d1bbfed690 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103480 Jun 29 10:20:37.230898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 747/1411] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:37.352971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:37.364754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad3231bf-76f7-43b3-85eb-08faaef8c4ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170038 Jun 29 10:20:37.365330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 665/1412] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:37 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:37.641204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:37.642171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:37.649756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:37.650204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:37.651020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:37.651458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:37.784094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:37.795549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-73f63182-4fba-40e8-9e08-2e41bfbbf554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160422 Jun 29 10:20:37.796295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 748/1413] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:38.249011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:38.249623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:38.256963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:38.257412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:38.258174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:38.258601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:38.320704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:38.329502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:38.331069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:38.332503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eb2fe909-c015-4742-9f67-3304466214e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087491 Jun 29 10:20:38.333090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 666/1414] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:38.389429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:38.390058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:38.398221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:38.398708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:38.399473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:38.399906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:38.548432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:38.561065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2bc372d4-2e79-45b6-8464-4275cf20c885 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.177376 Jun 29 10:20:38.561866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 749/1415] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:38 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:38.819416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:38.820019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:38.826717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:38.827161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:38.827918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:38.828345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:38.967495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:38.980097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-559ebfe6-1c96-4716-9b82-35a7f5f10591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165273 Jun 29 10:20:38.980947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 667/1416] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:38 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:39.355967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:39.357085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:39.365107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:39.365549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:39.366305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:39.366775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:39.432318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:39.441590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:39.443119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:39.444624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-debf6691-60a9-48cc-8ec9-e8a6e0619d98 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096151 Jun 29 10:20:39.445186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 750/1417] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:39.583292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:39.583965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:39.590888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:39.591466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:39.592087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:39.592522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:39.729851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:39.738901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13f13ba6-7128-425e-a442-20d192b5df7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160927 Jun 29 10:20:39.739474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 668/1418] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:39 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:40.002552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:40.003428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:40.009853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:40.010308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:40.011113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:40.011548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:40.159915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:40.170658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-077c55f4-d94b-4b49-a401-f01d9296407c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173011 Jun 29 10:20:40.171405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 751/1419] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:40.463815 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:40.464536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:40.471917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:40.472756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:40.473621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:40.474107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:40.544455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:40.553777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:40.555314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:40.556455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d78a39c-a4fb-4e45-abc1-01ffe85f2394 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097140 Jun 29 10:20:40.556998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 669/1420] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:40.755901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:40.756477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:40.763611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:40.764064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:40.764844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:40.765277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:40.904903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:40.914010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94bb7ec9-3f4d-4cbc-b39c-cff8a44d5f0f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162286 Jun 29 10:20:40.914588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 752/1421] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:41.189624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:41.190246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:41.197741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:41.198189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:41.199065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:41.199500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:41.339957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:41.348259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efd0529d-d76a-4ed3-b398-fd2166dc8335 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162628 Jun 29 10:20:41.348875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 670/1422] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:41 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:41.576203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:41.576834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:41.583422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:41.583875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:41.584645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:41.585093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:41.657055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:41.666480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:41.668036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:41.669150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eaf273df-9359-468b-bd35-afc8a1120913 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096961 Jun 29 10:20:41.669742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 753/1423] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:41.939649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:41.940441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:41.949914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:41.950484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:41.951641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:41.952119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:42.090840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:42.103862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa129bc5-60d8-4221-812e-1c2a7a6aa0c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169799 Jun 29 10:20:42.104738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 671/1424] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:41 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:42.367047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:42.367757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:42.375601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:42.376045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:42.376795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:42.377225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:42.516719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:42.520043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:42.527492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-79f2b471-48b2-4c6c-909f-4bacf795c528 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165387 Jun 29 10:20:42.528064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 754/1425] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:42 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:42.691207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:42.692070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:42.701876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:42.702485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:42.703675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:42.704302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:42.782530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:42.796725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:42.798197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:42.799544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cdc9dbc0-0dc2-47d9-b232-0a19e1ef3f55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114500 Jun 29 10:20:42.800115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 672/1426] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:43.128274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:43.129245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:43.136097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:43.136544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:43.137321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:43.137762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:43.276269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:43.284461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-65199086-2700-40de-b1ba-b0353d0a7108 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162587 Jun 29 10:20:43.285087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 755/1427] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:43 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:43.545980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:43.546620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:43.553685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:43.554144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:43.554927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:43.555359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:43.821996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:43.822630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:43.829721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:43.830170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:43.831062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:43.831447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:43.897070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:43.906463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:43.908040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:43.909223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-74be127b-92a7-429a-b0f3-09bbefa206cb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091936 Jun 29 10:20:43.909787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 756/1428] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:43.949266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:43.957656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e78bf17-3cfa-44e6-8f19-f31c3f22ba74 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.415668 Jun 29 10:20:43.958464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 673/1429] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:44.305109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:44.306027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:44.313848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:44.314294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:44.315097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:44.315526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:44.457911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:44.467841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2b1cf066-a876-49ee-a030-b2a8dab9c1c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168970 Jun 29 10:20:44.468417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 757/1430] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:44 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:44.929272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:44.929882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:44.937024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:44.937462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:44.938268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:44.938735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:44.980544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:44.981242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:44.988909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:44.989387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:44.990157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:44.990596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:45.007724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:45.017059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:45.018659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:45.019868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b3ffffa-bf2d-41b0-9762-4ddb3775808f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095317 Jun 29 10:20:45.020509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 674/1431] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:45.138625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:45.150277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c77927ab-26d5-4cf1-92af-c0ed61fbca6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173525 Jun 29 10:20:45.150881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 758/1432] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:44 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:45.486443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:45.487086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:45.494827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:45.495285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:45.496034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:45.496463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:45.644452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:45.647089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:45.654295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-afce7f1a-38d0-4596-b3f3-440b93c10045 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172068 Jun 29 10:20:45.654917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 675/1433] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:45 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:46.039185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:46.040572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:46.047742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:46.048194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:46.048961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:46.049375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:46.115612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:46.124385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:46.125894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:46.127110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4ad38689-2662-400d-bebc-4212be12d650 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092180 Jun 29 10:20:46.127696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 759/1434] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:46.169083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:46.169685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:46.177114 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:46.177638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:46.178552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:46.179068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:46.335253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:46.344552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-357db09e-2f03-49b9-a3cc-d460a11c314c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.179551 Jun 29 10:20:46.345125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 676/1435] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:46.674015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:46.674692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:46.683048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:46.683616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:46.684566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:46.685108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:46.835145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:46.844454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e18811be-42db-4fb9-8de6-e23f6a641a94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.175400 Jun 29 10:20:46.845017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 760/1436] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:46 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:47.145734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:47.146346 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:47.155078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:47.155078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:47.155078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:47.155494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:47.235956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:47.246987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:47.248477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:47.249662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37de2cfa-8c73-4884-9de8-e5e28d790772 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.108063 Jun 29 10:20:47.250503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 677/1437] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:47.363528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:47.364721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:47.370494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:47.370993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:47.371761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:47.372193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:47.573061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:47.581698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ee88d861-f05f-467d-a732-d161f693d591 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.222734 Jun 29 10:20:47.582253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 761/1438] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:47.862877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:47.863582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:47.870438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:47.870923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:47.871742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:47.872180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:48.027344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:48.039072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24fb5875-b83c-4885-a22f-62f2c8b49325 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.180149 Jun 29 10:20:48.039670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 678/1439] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:47 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:48.268347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:48.268852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:48.270843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=82 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:48.276660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:48.277168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:48.277949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:48.278369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:48.360289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:48.373256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:48.375173 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:48.376756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a0739fef-ab67-47b8-94f0-e4cf3eb09643 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.112290 Jun 29 10:20:48.377283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 762/1440] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:48.603688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:48.604475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:48.613598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:48.614328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:48.615119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:48.615552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:48.765666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:48.774457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cafdc44d-28cf-403a-a185-22f4a1bb690e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.175934 Jun 29 10:20:48.775072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 679/1441] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:49.060364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:49.061226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:49.069156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:49.069605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:49.070376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:49.070831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:49.225303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:49.233490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-006810e2-e167-4d7c-b0f9-0777b6e965e2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178869 Jun 29 10:20:49.234053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 763/1442] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:49 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:49.395424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:49.396217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:49.402656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:49.403124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:49.403885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:49.404320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:49.467867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:49.477006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:49.478496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:49.479674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-482aaadf-77e8-4e4d-a7f9-ccd4c8bbeeeb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088371 Jun 29 10:20:49.480231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 680/1443] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:49.792653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:49.793264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:49.800545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:49.800990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:49.801779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:49.802612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:49.950755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:49.962657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c34dce7-be2e-4124-83e7-5dfc375b27d6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173691 Jun 29 10:20:49.963539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 764/1444] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:49 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:50.254739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:50.255371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:50.265135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:50.265710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:50.266941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:50.267567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:50.418871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:50.431302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7208c64-7f0e-446a-8ed6-270211c12686 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.182624 Jun 29 10:20:50.432073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 681/1445] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:50 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:50.498106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:50.498872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:50.505340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:50.505852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:50.506772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:50.507206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:50.569566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:50.578194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:50.579717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:50.580855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a4c1d074-c462-4fac-8ed4-3cf262b0c420 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.086707 Jun 29 10:20:50.581388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 765/1446] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:50.987027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:50.987908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:50.995147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:50.995600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:50.996399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:50.996836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:51.138528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:51.147104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-65146400-0c2e-4577-8290-4a86af9646f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166016 Jun 29 10:20:51.147682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 682/1447] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:51.453011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:51.453627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:51.460599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:51.461046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:51.461810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:51.462238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:51.599813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:51.600850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:51.607174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:51.607945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:51.608382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:51.609158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:51.609593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:51.616263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-82df4bb7-e502-4d04-9b81-2caf3b1d1b73 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166378 Jun 29 10:20:51.616861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 766/1448] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:51.686791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:51.700032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:51.702420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:51.704410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3019c1ee-4241-4fb1-8e84-809159d1b506 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.108609 Jun 29 10:20:51.705144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 683/1449] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:52.167804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:52.168675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:52.179163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:52.179980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:52.181139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:52.181861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:52.334916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:52.343314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-007bc0d2-e0af-4528-8d9a-3dfc8836ff9a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.182114 Jun 29 10:20:52.343910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 767/1450] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:20:52.634658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:52.635271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:52.642077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:52.642529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:52.643329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:52.643764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:52.723847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:52.724466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:52.731821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:52.732255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:52.733071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:52.733493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:52.779538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:52.788225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-20cac118-148f-4cc8-a7ab-2bb350947dbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157582 Jun 29 10:20:52.789075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 684/1451] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:52 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:52.799444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:52.812542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:52.814809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:52.816329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-28b842b7-2cb1-4650-9390-1bf19bb34cfd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096395 Jun 29 10:20:52.817063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 768/1452] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:53.360595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:53.361108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:53.368017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:53.368461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:53.369251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:53.369699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:53.507270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:53.516260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f5e32be-4766-49b7-a084-30c6dbfa071a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159667 Jun 29 10:20:53.516818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 685/1453] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:53.807209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:53.807826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:53.814844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:53.814844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:53.815556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:53.816030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:53.836489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:53.837195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:53.844827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:53.845296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:53.846104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:53.846624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:53.915035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:53.924100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:53.925695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:53.926961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57a9d65e-af5c-49e2-983d-37a2f137d51b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095410 Jun 29 10:20:53.927627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 686/1454] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:53.952393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:53.960807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f934199c-59e1-4044-b885-137a9fc600dc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157933 Jun 29 10:20:53.961377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 769/1455] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:54.540121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:54.540731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:54.547526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:54.547977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:54.548738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:54.549172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:54.701018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:54.711762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4137688-4a44-45be-994b-668dd05c98fd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.175606 Jun 29 10:20:54.712345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 687/1456] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:54 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:54.947833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:54.948439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:54.955482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:54.955928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:54.956692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:54.957148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:54.978883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:54.979611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:54.986377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:54.986867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:54.987638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:54.988075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:55.023893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:55.033158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:55.034685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:55.035843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ba381079-2736-459f-80c5-14d4575a419a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093181 Jun 29 10:20:55.036399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 770/1457] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:55.126651 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:55.136097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3bd05037-8030-4b91-be20-5b6722b62b89 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161979 Jun 29 10:20:55.136668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 688/1458] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:54 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:20:55.729709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:55.730320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:55.737310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:55.737765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:55.738526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:55.738991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:55.754205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:55.879195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:55.888632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-66d014db-f7e7-4a34-89af-e167c575b5a4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162991 Jun 29 10:20:55.889203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 771/1459] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:55 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:56.055880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:56.056282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:56.063033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:56.063480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:56.064301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:56.065194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:56.128236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:56.137303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:56.138840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:56.140007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dd457287-abf4-4063-9609-d461dbf57a07 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088891 Jun 29 10:20:56.140546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 689/1460] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:56.155078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:56.155713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:56.166182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:56.166790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:56.167984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:56.168617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:56.304102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:56.312500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fdf9dc4c-da96-4ba2-8244-0bb799cfe27f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162863 Jun 29 10:20:56.313072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 772/1461] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:56.908241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:56.909024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:56.917926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:56.918631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:56.919848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:56.920423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:57.061268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:57.073653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1409cdb9-d091-4910-ab67-7f7a5370cfee tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171031 Jun 29 10:20:57.074426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 690/1462] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:56 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:57.157611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:57.158192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:57.165884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:57.166325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:57.167157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:57.167581 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:57.238514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:57.247766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:57.249534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:57.250713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b4342b2-88ae-4ae8-be50-cbd864e80eea tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097061 Jun 29 10:20:57.251238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 773/1463] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:57.330323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:57.330939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:57.337564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:57.338011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:57.338836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:57.339273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:57.484583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:57.493303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d37a8269-7d4f-43d2-b808-00d5d9837a92 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167032 Jun 29 10:20:57.493872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 691/1464] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:57 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:58.095942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:58.096560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:58.103504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:58.103949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:58.104714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:58.105136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:58.249492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:58.257616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f55b26c7-0a43-477c-934f-db9332ef0da1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165600 Jun 29 10:20:58.258178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 774/1465] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:58.268817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:58.269451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:58.275975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:58.276392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:58.277143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:58.277572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:58.293715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:20:58.350483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:58.359957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:58.361475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:58.362659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-790fb8f2-79ac-4dd1-9666-fab0fd43eb92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097869 Jun 29 10:20:58.363208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 692/1466] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:58.518070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:58.518722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:58.525485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:58.525944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:58.526755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:58.527196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:58.677220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:58.685876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-92788352-5b38-4c89-aaaf-01a205ab6e91 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173131 Jun 29 10:20:58.686453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 775/1467] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:58 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:59.275733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:59.276391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:59.283320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:59.283764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:59.284547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:59.284975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:59.383475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:59.384087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:59.390776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:59.391243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:59.391998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:59.392428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:59.431156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:59.439630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-85d8749b-8b07-43e0-9c73-5128d4f8b027 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167878 Jun 29 10:20:59.440199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 693/1468] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:20:59.454980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:59.463653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:59.465149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:59.466313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b378d333-0a63-4220-89af-4e690cd43635 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088816 Jun 29 10:20:59.466922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 776/1469] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:20:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:20:59.708032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:20:59.708837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:20:59.715692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:59.716141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:59.716889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:20:59.717345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:20:59.858082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:20:59.867214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cd76ce03-7f90-44e5-8b24-1ac65f125099 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164199 Jun 29 10:20:59.867620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 694/1470] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:20:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:00.457599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:00.458211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:00.465605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:00.466090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:00.466875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:00.467317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:00.484808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:00.485557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:00.492991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:00.493448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:00.494244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:00.494718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:00.560602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:00.569742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:00.571288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:00.572496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de335b30-a261-48af-9120-286d4ad5ec0f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091768 Jun 29 10:21:00.573288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 695/1471] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:00.602684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:00.611644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a76792f-1a2d-4fa8-b6d4-25bd2de103a9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.157965 Jun 29 10:21:00.612306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 777/1472] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:00 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:00.892961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:00.893711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:00.901327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:00.901779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:00.902549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:00.903213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:01.056273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:01.066695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-941b582a-ace6-4bae-8264-9cdde5148458 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178824 Jun 29 10:21:01.067791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 696/1473] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:01.597029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:01.597685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:01.605903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:01.606359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:01.607186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:01.607670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:01.636360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:01.636943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:01.643715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:01.644165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:01.646842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:01.647562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:01.677443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:01.686894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:01.688394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:01.689645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-626f28ae-868f-4950-8bbf-d30cffd7a0ef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098043 Jun 29 10:21:01.689645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 778/1474] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:01.792886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:01.801218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a8527d8c-894b-4a72-8d40-546da2beca35 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171223 Jun 29 10:21:01.801795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 697/1475] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:01 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:02.085881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:02.086496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:02.093829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:02.094272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:02.095083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:02.095517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:02.235841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:02.244522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3e527ca6-77dc-44cc-ab2a-c6d9eab76ce0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163207 Jun 29 10:21:02.245095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 779/1476] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:02.708708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:02.709332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:02.719827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:02.720553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:02.721749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:02.722410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:02.793832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:02.805802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:02.807341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:02.808563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7bf4dfc-4011-4136-ad49-b1f8240dbd65 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103886 Jun 29 10:21:02.809120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 698/1477] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:02.819213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:02.819829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:02.826610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:02.827069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:02.827843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:02.828283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:02.969092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:02.977436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7c6b4f2b-b51b-42e5-a030-c3130cda7ebb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162472 Jun 29 10:21:02.978012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 780/1478] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:02 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:03.263068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:03.263585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:03.272647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:03.273196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:03.274379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:03.275130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:03.418407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:03.427078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3d61a81e-4bc9-40cd-9eaa-6cf70f8f76fd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168857 Jun 29 10:21:03.427652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 699/1479] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:03 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:03.826371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:03.827285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:03.834285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:03.834881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:03.835716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:03.836161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:03.905019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:03.918801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:03.921570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:03.922947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e30451d7-9ef3-42ae-bdba-81ecd3e6f55d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100574 Jun 29 10:21:03.923536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 781/1480] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:03.995662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:03.996271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:04.003728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:04.004234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:04.005096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:04.005531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:04.144431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:04.155583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de82acad-ffdf-4a54-b3b5-73992ad0aebc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164053 Jun 29 10:21:04.156497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 700/1481] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:03 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:04.450982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:04.451743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:04.461016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:04.461463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:04.462226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:04.462691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:04.618540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:04.630615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-231c3470-2d67-48f8-b144-f10acf5bf46b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.184406 Jun 29 10:21:04.631409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 782/1482] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:04 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:04.942486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:04.943508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:04.950811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:04.951331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:04.952200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:04.952683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:05.019283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:05.028454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:05.029935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:05.031097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33e5a6cb-3e1c-447c-a9fd-8bd3fee5f06e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093366 Jun 29 10:21:05.031663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 701/1483] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:05.174747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:05.175361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:05.183166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:05.183606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:05.184381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:05.184801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:05.323836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:05.332116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-97abe591-be52-43fb-b0c6-c141aea65e3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161291 Jun 29 10:21:05.332687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 783/1484] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:05.649688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:05.650859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:05.657383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:05.657840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:05.658596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:05.659063 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:05.814898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:05.824594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de938313-4071-465b-a480-2b4d104b847e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179023 Jun 29 10:21:05.825163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 702/1485] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:05 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:06.050454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:06.051091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:06.058097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:06.058823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:06.060007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:06.060604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:06.130382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:06.139222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:06.140718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:06.141864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a73c333e-5e9d-4276-80b5-8f8c286273a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096789 Jun 29 10:21:06.142414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 784/1486] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:06.350730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:06.351996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:06.359144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:06.359599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:06.360367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:06.360833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:06.508599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:06.517365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2aeb5c7f-9013-43d9-904e-8c0d431ab08e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170606 Jun 29 10:21:06.517942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 703/1487] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:06.842781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:06.843425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:06.853235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:06.853833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:06.854930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:06.855366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:06.991545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:07.000611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-755766d9-96c6-4914-a9d7-bf2443ca5799 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161913 Jun 29 10:21:07.001186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 785/1488] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:06 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:07.160423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:07.161059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:07.167611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:07.168065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:07.168829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:07.169263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:07.236644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:07.245816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:07.247353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:07.248508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d05b53b7-e70b-4745-84c1-d0bd162aeef0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092098 Jun 29 10:21:07.249074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 704/1489] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:07.535670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:07.536215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:07.543510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:07.543966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:07.544759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:07.545189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:07.695719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:07.705133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2579476f-14b4-4698-ba5b-af2c95174b9e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173730 Jun 29 10:21:07.705730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 786/1490] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:07 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:08.017796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:08.018400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:08.020947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:08.027714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:08.028155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:08.028931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:08.029362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:08.167172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:08.179274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89a923b6-e9c2-4046-a869-85b08226d4d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165068 Jun 29 10:21:08.179978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 705/1491] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:08 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:08.270225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:08.271131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:08.280818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:08.281521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:08.282802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:08.283429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:08.353521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:08.363665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:08.365173 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:08.366318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-28aedad6-ccce-43ad-a74e-abb8953e1669 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102314 Jun 29 10:21:08.366902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 787/1492] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:08.723389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:08.724101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:08.731538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:08.732010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:08.732874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:08.733382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:08.864634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:08.873427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0d4283c-09b5-438f-b10c-59ad9165e4a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.154546 Jun 29 10:21:08.874010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 706/1493] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:09.198298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:09.199495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:09.206050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:09.206498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:09.207329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:09.207753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:09.210293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:09.352689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:09.361720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e6c2bba6-9264-4720-8f4d-2f241c06d210 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167305 Jun 29 10:21:09.362251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 788/1494] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:09.390004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:09.390634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:09.397532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:09.397978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:09.398775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:09.399208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:09.478108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:09.491229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:09.493707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:09.495501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa88f401-36e0-40fc-bb5a-aa8631c43427 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.109803 Jun 29 10:21:09.496070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 707/1495] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:09.891661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:09.892182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:09.898787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:09.899270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:09.900043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:09.900459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:10.043609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:10.051778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d8704b7f-630d-4f78-9607-c0868e99970e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164094 Jun 29 10:21:10.052572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 789/1496] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:09 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:10.379740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:10.380352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:10.390293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:10.391226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:10.392131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:10.392869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:10.513896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:10.514503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:10.521661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:10.522108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:10.522893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:10.523335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:10.535236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:10.544118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a71b6d16-6e8e-4ea2-a73b-79d9122ddfc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168289 Jun 29 10:21:10.544906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 708/1497] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:10 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:10.592687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:10.601539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:10.603079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:10.604233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3644d425-4fe6-4baf-b638-e3508ff5453a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094423 Jun 29 10:21:10.604795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 790/1498] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:11.070984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:11.071874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:11.080384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:11.081095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:11.081935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:11.082375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:11.086098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:11.222074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:11.232637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b57c10a-96d7-41e5-bde3-50a078941102 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166254 Jun 29 10:21:11.233834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 709/1499] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:11.562315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:11.562973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:11.570391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:11.570887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:11.571661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:11.572120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:11.624400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:11.625099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:11.632930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:11.633381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:11.634232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:11.634759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:11.702825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:11.709256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:11.711527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:11.713015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:11.714193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06f13a0f-232c-4024-a0ba-4c65e7c9381c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094695 Jun 29 10:21:11.714929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 710/1500] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:11.717415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d30a91cf-0909-45ef-a09a-e9cfd8b63de4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159432 Jun 29 10:21:11.717985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 791/1501] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:11 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:12.251317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:12.251923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:12.260361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:12.260969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:12.261855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:12.262297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:12.404817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:12.413161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ef07c6ba-64d8-4063-b76d-25449afe7b13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165811 Jun 29 10:21:12.413715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 711/1502] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:12 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:12.734862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:12.735572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:12.735863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:12.736454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:12.742511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:12.743007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:12.743371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:12.743783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:12.743953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:12.744207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:12.744577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:12.744995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:12.807073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:12.816145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:12.817629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:12.819183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-958bf7ce-d3fa-46d6-9c91-b602b17b288d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089883 Jun 29 10:21:12.819767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 792/1503] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:12.880323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:12.889416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51d527f7-90a9-480a-84f9-d9495212a428 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157378 Jun 29 10:21:12.890002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 712/1504] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:12 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:13.435512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:13.436618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:13.445164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:13.445616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:13.446422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:13.446866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:13.597855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:13.608343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b121f236-5b17-428f-8f3e-5095e77269cb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.181580 Jun 29 10:21:13.609182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 793/1505] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:13 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:13.840684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:13.841280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:13.848570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:13.849020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:13.849792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:13.850217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:13.907353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:13.907995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:13.914703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:13.915138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:13.915951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:13.916382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:13.924427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:13.933548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:13.935241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:13.936371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2cb70031-d724-4560-a16e-97cfcff19939 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100069 Jun 29 10:21:13.936915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 713/1506] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:14.059384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:14.067402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2ba2baf1-6aec-4149-88e0-c6c2450598b9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163951 Jun 29 10:21:14.068329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 794/1507] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:13 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:14.626287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:14.626946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:14.634385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:14.634842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:14.635629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:14.636056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:14.784224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:14.792457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc2a2476-b5ce-4cd8-bea8-6299c84a621e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170157 Jun 29 10:21:14.793071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 714/1508] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:14 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:14.955318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:14.955918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:14.963185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:14.963627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:14.964428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:14.965003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:15.026964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:15.036299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:15.037792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:15.039007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f81cee9d-248c-4c2b-82b7-63ec27d2571b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087670 Jun 29 10:21:15.039564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 795/1509] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:15.092951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:15.093649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:15.100708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:15.101143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:15.102013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:15.102460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:15.238781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:15.248287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c9dd638e-6c73-49c1-aced-4fbc1348a44d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161303 Jun 29 10:21:15.248870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 715/1510] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:15 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:15.810817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:15.811418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:15.818380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:15.818857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:15.819610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:15.820049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:15.960427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:15.969139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a25607c3-694d-417f-91c0-9dd8faf8f878 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162811 Jun 29 10:21:15.969673 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 796/1511] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:15 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:16.059843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:16.060464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:16.067200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:16.068001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:16.068786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:16.069225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:16.153786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:16.163270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:16.164699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:16.165835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05959efb-580a-4ea4-a9fc-61a5b4d2c65e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.110173 Jun 29 10:21:16.166397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 716/1512] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:16.268249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:16.268908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:16.277993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:16.278446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:16.279272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:16.279706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:16.413694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:16.427310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ec87ddbb-b8ee-43e2-8dc4-70704c95669e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164638 Jun 29 10:21:16.428221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 797/1513] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:16 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:16.988661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:16.989384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:16.998160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:16.998611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:16.999392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:16.999823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:17.154138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:17.164876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-399c8544-7cde-4da6-9caa-c615586ec8d7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.181658 Jun 29 10:21:17.165732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 717/1514] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:17.187460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:17.188364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:17.198533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:17.199238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:17.200494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:17.201152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:17.280510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:17.294202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:17.295427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:17.296584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6892a5d4-677e-4ad2-b582-53103f97b1e5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114633 Jun 29 10:21:17.297120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 798/1515] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:17.448405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:17.449018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:17.456131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:17.456603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:17.457365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:17.457800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:17.610464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:17.619139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fde890cd-ea6b-46eb-b4ad-b53545d14c28 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174735 Jun 29 10:21:17.619722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 718/1516] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:17 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:18.185777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:18.187087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:18.194717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:18.195308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:18.195915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:18.196352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:18.315545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:18.316129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:18.323487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:18.323945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:18.324721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:18.325162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:18.338277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:18.349078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ab17403a-361c-4c5e-a131-49e116b05bca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167246 Jun 29 10:21:18.349639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 799/1517] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:18.392845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:18.401664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:18.403200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:18.404360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1016a9f5-febf-4417-a574-64478113c124 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093258 Jun 29 10:21:18.405240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 719/1518] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:18.636880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:18.637397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:18.639653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=76 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:18.646475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:18.647090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:18.647911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:18.648344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:18.791725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:18.801676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-323bc784-b4e9-4340-aff7-f7dcb331bcdd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168889 Jun 29 10:21:18.802272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 800/1519] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:18 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:19.367460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:19.368047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:19.375397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:19.375853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:19.376623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:19.377086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:19.423613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:19.424243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:19.431048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:19.431501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:19.432282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:19.432716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:19.494634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:19.503532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:19.505027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:19.506178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a570bef0-4df8-48e8-90b4-8a2227ca565e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.086739 Jun 29 10:21:19.506826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 801/1520] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:21:19.515151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:19.524871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2902140-9d1e-4f59-a62d-a5df814fc701 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161508 Jun 29 10:21:19.525624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 720/1521] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:19.823459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:19.824474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:19.831917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:19.832358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:19.833123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:19.833552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:19.993231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:20.002395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-97e47820-cfa3-47e9-9a2f-d884111a4588 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185391 Jun 29 10:21:20.003026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 802/1522] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:19 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:20.527350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:20.528253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:20.536199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:20.536650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:20.537417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:20.537882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:20.545287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:20.546016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:20.553039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:20.553489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:20.554272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:20.554740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:20.603021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:20.612207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:20.613707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:20.614895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f5d4b40-8c52-4ec6-820c-dfc7e1044cd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093387 Jun 29 10:21:20.615428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 721/1523] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:20.701476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:20.710188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70624f71-ecc8-4186-8d39-fcd74b6ae316 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168967 Jun 29 10:21:20.710785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 803/1524] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:20 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:21.020371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:21.021068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:21.028142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:21.028652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:21.029512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:21.030006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:21.170164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:21.182090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8444d509-dd8f-4d0a-b256-1e687b12f942 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165852 Jun 29 10:21:21.182912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 722/1525] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:21 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:21.633547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:21.634113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:21.641172 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:21.641629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:21.642652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:21.643002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:21.722483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:21.724847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:21.727749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:21.728368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:21.733520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:21.736790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:21.738618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-59a8a3fb-29da-419c-86d1-2fb7b9203b2c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.108801 Jun 29 10:21:21.739307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 804/1526] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:21.742369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:21.742865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:21.743655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:21.744224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:21.903563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:21.912896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d627bb7e-928d-42e0-8a53-0fb8ad89a4c4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.189184 Jun 29 10:21:21.913475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 723/1527] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:22.204924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:22.205565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:22.212311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:22.212760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:22.213541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:22.213975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:22.346917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:22.355178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-631f0649-83c3-486f-8ff6-3e6e374c45f7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156421 Jun 29 10:21:22.355753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 805/1528] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:22 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:22.759364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:22.759978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:22.767728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:22.768171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:22.768935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:22.769377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:22.835162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:22.848027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:22.850103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:22.851876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-07668f8b-aed0-4c52-8d35-93c79f810dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096317 Jun 29 10:21:22.852727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 724/1529] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:22.932791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:22.933383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:22.941902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:22.942354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:22.943545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:22.943976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:23.087888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:23.096660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-43a90c18-3f09-474e-a277-f150674c7be3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169885 Jun 29 10:21:23.097231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 806/1530] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:22 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:23.373663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:23.374167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:23.381204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:23.381653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:23.382405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:23.382873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:23.535729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:23.538073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:23.548322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34aa1254-3574-494c-8d20-1f7424d72f7c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178347 Jun 29 10:21:23.549491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 725/1531] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:23 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:23.873547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:23.874163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:23.881198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:23.881645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:23.882410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:23.882873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:23.950274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:23.963671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:23.965355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:23.967058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0defa2aa-c279-4017-b206-ffed1d1fd5a6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097449 Jun 29 10:21:23.967687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 807/1532] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:24.117106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:24.117869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:24.128615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:24.129056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:24.129816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:24.130246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:24.265807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:24.274225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-022eac87-9a4e-4b97-ae80-5de12bc208d5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163593 Jun 29 10:21:24.274825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 726/1533] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:24.571070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:24.571716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:24.578209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:24.578682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:24.579478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:24.579905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:24.718084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:24.726537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff57e13e-2682-4fec-b786-a35179f792eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162899 Jun 29 10:21:24.727133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 808/1534] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:24 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:24.986754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:24.987439 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:24.993935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:24.994375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:24.995165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:24.995595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:25.063506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:25.073573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:25.075091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:25.076241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-802fd099-216b-49ac-bda3-3d3de2808d92 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093850 Jun 29 10:21:25.076828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 727/1535] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:25.293147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:25.293734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:25.301306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:25.301753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:25.302517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:25.303016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:25.439848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:25.449729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c5e7acf4-701f-4365-bb39-915bb6578b50 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160064 Jun 29 10:21:25.450637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 809/1536] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:25 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:25.751027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:25.751724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:25.758725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:25.759173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:25.759933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:25.760363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:25.900520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:25.913768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a26fa6d-8f96-4b2a-8ee6-9dd6223a3adf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166440 Jun 29 10:21:25.914690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 728/1537] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:25 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:26.095649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:26.096255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:26.103480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:26.103922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:26.104719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:26.105148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:26.171025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:26.180528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:26.182028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:26.183526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-84a2e53d-9903-4eda-9b91-bfdb09474622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091953 Jun 29 10:21:26.184085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 810/1538] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:26.472122 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:26.472736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:26.479295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:26.479766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:26.480538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:26.480971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:26.618682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:26.627340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8fb0787-b310-4140-a612-85bb47e0daab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159132 Jun 29 10:21:26.628598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 729/1539] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:26 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:26.934846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:26.935459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:26.943014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:26.943523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:26.944294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:26.944731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:27.203392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:27.203973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:27.211281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:27.211732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:27.212507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:27.212952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:27.280259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:27.290061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:27.292113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:27.293300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f35309da-563a-4b87-8998-b9d737c4b2fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094003 Jun 29 10:21:27.293861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 730/1540] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:27.329410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:27.337545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d6f217c6-8244-4db5-bbca-2e785218e941 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.406677 Jun 29 10:21:27.338123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 811/1541] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:26 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:27.645914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:27.646514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:27.653243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:27.653690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:27.654444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:27.654910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:27.808152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:27.819293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-527a3ed5-59d4-454c-9f74-e328f886ae66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.177467 Jun 29 10:21:27.819866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 731/1542] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:28.316013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:28.316593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:28.323882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:28.324335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:28.325105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:28.325545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:28.355270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:28.355975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:28.363048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:28.363520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:28.364618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:28.365022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:28.389779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:28.398917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:28.400449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:28.401602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3905e5ca-336c-42bd-a575-f67c07b99609 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092016 Jun 29 10:21:28.402148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 812/1543] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:28.500180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:28.508554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-432cd4c3-760b-4991-ba71-95b952144cb6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157324 Jun 29 10:21:28.509128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 732/1544] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:28 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:28.838077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:28.838751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:28.845254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:28.845701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:28.846467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:28.846954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:28.983953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:28.992453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2cdf5208-2831-434b-8617-80c84dba3639 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.158644 Jun 29 10:21:28.992996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 813/1545] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:29.422782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:29.423424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:29.430516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:29.431002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:29.431765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:29.432202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:29.508917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:29.517821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:29.519393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:29.521002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f8e45b1-f48e-41c3-8208-29654d3af969 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102074 Jun 29 10:21:29.521707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 733/1546] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:29.530429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:29.531065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:29.541169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:29.541808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:29.542974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:29.543401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:29.698694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:29.707541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9ae353c1-cdb4-4b1c-b84a-a07f526839fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185866 Jun 29 10:21:29.708148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 814/1547] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:29 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:30.009902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:30.010514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:30.017212 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:30.017698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:30.018438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:30.018906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:30.153863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:30.166519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fad780e0-8f2a-4ec0-9713-671ea82f4e78 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160340 Jun 29 10:21:30.167385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 734/1548] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:30.542834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:30.543684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:30.553671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:30.554400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:30.555652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:30.556382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:30.644879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:30.657617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:30.659947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:30.661635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-67b17745-aa6d-49db-8490-652506dee355 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.125757 Jun 29 10:21:30.662204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 815/1549] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:30.734621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:30.735529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:30.746952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:30.747717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:30.748983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:30.749703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:30.894493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:30.903688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e39495e7-3897-4248-9576-155031297617 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.175954 Jun 29 10:21:30.904261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 735/1550] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:30 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:31.187538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:31.188148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:31.195668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:31.196140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:31.196901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:31.197331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:31.336405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:31.348633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cf27c826-0fa3-402e-9bf3-da7753d01ff3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165087 Jun 29 10:21:31.349191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 816/1551] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:31.682433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:31.683043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:31.690317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:31.690850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:31.691828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:31.693184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:31.760965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:31.770301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:31.772280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:31.773432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62a9bf57-d421-44bf-b25a-3ee1abb84641 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095693 Jun 29 10:21:31.773987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 736/1552] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:31.923368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:31.923932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:31.931618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:31.932067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:31.932794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:31.933261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:32.072162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:32.080572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80472be0-ff29-4d4e-99e0-ccfd0cbb4b84 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163183 Jun 29 10:21:32.081150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 817/1553] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:31 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:32.374018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:32.374851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:32.383387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:32.383831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:32.384590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:32.385014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:32.521164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:32.532764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9c854af-7ecb-4088-8c6d-bda235bd71ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164844 Jun 29 10:21:32.535155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 737/1554] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:32 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:32.793363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:32.794083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:32.803252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:32.803801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:32.804648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:32.805154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:32.885374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:32.899270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:32.901688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:32.903512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-851846c7-b70b-40d1-aa34-a87e1d8864dc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114679 Jun 29 10:21:32.904523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 818/1555] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:33.097681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:33.098392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:33.105556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:33.106014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:33.106820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:33.107249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:33.259200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:33.271371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bcbb09d2-cb9d-427a-a5e2-69f2f863c6d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.177662 Jun 29 10:21:33.271905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 738/1556] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:33 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:33.553432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:33.554180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:33.562460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:33.563250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:33.564464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:33.565183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:33.707567 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:33.716385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-501c965b-521e-4d80-9749-a6ffd170e9f3 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169249 Jun 29 10:21:33.717176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 819/1557] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:33 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:33.926039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:33.926681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:33.933159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:33.933612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:33.934379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:33.934840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:34.008159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:34.017457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:34.019004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:34.020157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b081cf8-b21e-413b-8d02-0ac319486c6e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098647 Jun 29 10:21:34.020877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 739/1558] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:34.289347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:34.289994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:34.296791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:34.297251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:34.298020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:34.298449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:34.445355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:34.453705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f43aa30f-9791-46a4-a98b-2185efca6781 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168527 Jun 29 10:21:34.454278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 820/1559] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:34 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:34.737019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:34.737595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:34.745219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:34.745685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:34.746451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:34.746920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:34.883434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:34.896527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-419bc91a-c261-4512-a8f3-4c36d84b4b30 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165584 Jun 29 10:21:34.897085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 740/1560] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:35.044488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:35.045050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:35.052164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:35.052627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:35.053392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:35.053828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:35.071148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:35.122692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:35.132808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:35.134307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:35.135595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3edc0e56-e04c-4dc2-af7e-e3e65c2981aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100024 Jun 29 10:21:35.136165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 821/1561] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:35.471443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:35.472053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:35.479357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:35.479809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:35.480563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:35.480993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:35.618074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:35.626256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-333f05ec-cace-4567-89f3-71c9de7f71c1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158740 Jun 29 10:21:35.626852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 741/1562] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:35 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:35.914687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:35.915184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:35.921610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:35.922052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:35.922876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:35.923317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:36.058293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:36.067123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9b09d612-c4e6-49d0-939c-64640c3989b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.157358 Jun 29 10:21:36.067965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 822/1563] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:35 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:36.154061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:36.154714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:36.162577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:36.163055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:36.163820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:36.164248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:36.180399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:36.237270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:36.247514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:36.249166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:36.250315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-398f2697-7c27-4c7e-9e5e-5aecb03c702a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100235 Jun 29 10:21:36.250902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 742/1564] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:36.650661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:36.651608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:36.661667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:36.662122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:36.662954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:36.663365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:36.802849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:36.811349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7e53838e-9f1e-4dc3-a754-c0dd13ab2506 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166807 Jun 29 10:21:36.811905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 823/1565] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:36 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:37.285081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:37.285799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:37.294178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:37.294288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:37.295321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:37.295751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:37.344124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:37.350634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:37.360546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:37.360996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:37.361780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:37.362218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:37.374180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:37.386282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:37.387811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:37.388976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19fdf1e4-9ab3-496a-be35-3c22222aa584 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.122814 Jun 29 10:21:37.389540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 824/1566] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:37.505880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:37.514095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f870903c-5ac9-400e-9243-f4e969dd2358 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.432946 Jun 29 10:21:37.514668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 743/1567] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:37.831090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:37.831691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:37.838949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:37.839395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:37.840154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:37.840578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:37.974393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:37.983255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3992fa0b-0a6e-4e23-9774-b37ea742de27 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156095 Jun 29 10:21:37.983801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 825/1568] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:37 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:38.408412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:38.409036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:38.410894 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:38.416571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:38.417080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:38.417885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:38.418280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:38.489296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:38.498997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:38.500477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:38.501631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0cd6d50d-073a-4419-ab1d-d3a3520e716b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097959 Jun 29 10:21:38.502211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 744/1569] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:38.531932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:38.532511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:38.540098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:38.540550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:38.541320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:38.541780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:38.681232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:38.689885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a98d8b7c-f389-4d02-bf04-bfbc8d7adbe2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161827 Jun 29 10:21:38.690472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 826/1570] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:38 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:38.859888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:38.860352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:38.867791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:38.868235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:38.868982 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:38.869768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:38.898801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:21:38.989758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b46bf7dc-6592-4669-a179-9637f26e23ad tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 204 len: 0 microversion: 2.1 time: 0.132574 Jun 29 10:21:38.990371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 745/1571] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:21:38 2022] DELETE /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:21:38.998878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:38.999493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:39.004023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:39.004733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:39.005916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.006459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.007323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.007760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.010801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.011257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.012022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.012456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.145375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:39.148045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:39.153665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eba0518d-174e-4fbe-9c07-608e285e72cc tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1681 microversion: 2.1 time: 0.158796 Jun 29 10:21:39.154247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 827/1572] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:38 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:39.157441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-17ffabd4-6d48-4595-8d0c-aebd046288c3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156809 Jun 29 10:21:39.157441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 746/1573] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:38 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:39.520425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:39.521033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:39.530026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.530497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.531309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.531759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.627493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:39.636857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:39.638383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:39.639591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e11ef4aa-08b1-4b8c-b2e7-3838aef85176 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.123284 Jun 29 10:21:39.640390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 828/1574] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:39.707882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:39.708593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:39.716341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.716904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.717646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:39.718072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:39.853785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:39.862143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3eb0590-b8e4-4043-bc61-b14f9c1e312e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.158194 Jun 29 10:21:39.863041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 747/1575] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:40.171807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:40.172431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:40.173263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:40.173901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:40.180299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.181190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.181647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.181823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.182065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.182584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.182822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.183288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.260462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229771b215b3492abc2c5ec38ff0d929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702000a5942b41689821164e169520d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:40.268814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2cc372e3-e7ea-42be-8374-0b98cadaa2f1 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 200 len: 1613 microversion: 2.1 time: 0.101029 Jun 29 10:21:40.269391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 829/1576] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:40 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:40.329274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-d50a10a3-3e45-433e-b632-b3724657c1b5 req-f1d8993e-cc02-4d63-ad1f-ba27a1a2b22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b391700-0ca4-43cf-8beb-697c52208176", "name": "network-vif-deleted", "tag": "c03d5a6f-b2b8-4a7c-b171-7a3f991e439c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:21:40.338510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:40.348103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d50a10a3-3e45-433e-b632-b3724657c1b5 req-f1d8993e-cc02-4d63-ad1f-ba27a1a2b22e service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.348546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-d50a10a3-3e45-433e-b632-b3724657c1b5 req-f1d8993e-cc02-4d63-ad1f-ba27a1a2b22e service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.356091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-add6b3d3-a39d-4708-82d2-aa28fae5c890 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185909 Jun 29 10:21:40.357743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 748/1577] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:40.368494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-d50a10a3-3e45-433e-b632-b3724657c1b5 req-f1d8993e-cc02-4d63-ad1f-ba27a1a2b22e service nova] Creating event network-vif-deleted:c03d5a6f-b2b8-4a7c-b171-7a3f991e439c for instance 8b391700-0ca4-43cf-8beb-697c52208176 on hv-cinder-76810 Jun 29 10:21:40.370288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-d50a10a3-3e45-433e-b632-b3724657c1b5 req-f1d8993e-cc02-4d63-ad1f-ba27a1a2b22e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045897 Jun 29 10:21:40.374100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 830/1578] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:21:40.657678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:40.658286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:40.665280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.665727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.666500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.666968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.739237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:40.750368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:40.752553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:40.753720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-33698a2c-82b2-4f64-ad52-93449309898d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100141 Jun 29 10:21:40.756842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 749/1579] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:40.882023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:40.882815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:40.889358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.889803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:40.890597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:40.891024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.028615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:41.036787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4a692b79-cb8b-4103-a22f-1adb58ff8d1f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160403 Jun 29 10:21:41.037351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 831/1580] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:41.285943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:41.286604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:41.293296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:41.293751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.294781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:41.295234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.310853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 HTTP/1.1 Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:21:41.312422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:21:41.314110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '8b391700-0ca4-43cf-8beb-697c52208176'} Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:21:41.315176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:21:41.316886 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:21:41.318838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:21:41.318838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04a54011-2af2-450c-a150-e85580410503 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 404 len: 111 microversion: 2.1 time: 0.031878 Jun 29 10:21:41.318838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 750/1581] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:41 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:21:41.324010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9cc13a83-a0a3-45a5-bd63-1cc16afbe3bd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '.version_select at 0x7f38703f2c10>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:41.327300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9cc13a83-a0a3-45a5-bd63-1cc16afbe3bd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [18f7360d-afdb-4390-a666-f88b5511f48c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 10:21:41.375782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:41.376433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:41.383347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:41.383803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.384605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:41.385046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.523215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:41.531644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e54d737f-b439-42bc-9f50-bc25fe5d57f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159759 Jun 29 10:21:41.532216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 751/1582] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:41 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:41.781064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:41.781781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:41.789059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:41.789536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.790302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:41.790766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:41.857000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:41.867647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:41.869503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:41.870704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a4e35a0-08bd-4ba2-84c9-8f1dd11e2044 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093715 Jun 29 10:21:41.871261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 752/1583] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:42.056017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:42.056319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:42.062842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:42.063297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:42.064056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:42.064483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:42.213923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:42.226163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa6d4688-a200-444e-9680-2b181437ea62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.174993 Jun 29 10:21:42.226795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 753/1584] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:42 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:42.336367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [None req-9cc13a83-a0a3-45a5-bd63-1cc16afbe3bd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [18f7360d-afdb-4390-a666-f88b5511f48c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 49182. Jun 29 10:21:42.356672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9cc13a83-a0a3-45a5-bd63-1cc16afbe3bd tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-98468437" status: 202 len: 0 microversion: 2.1 time: 1.036827 Jun 29 10:21:42.357276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 832/1585] 10.222.0.52 () {58 vars in 1214 bytes} [Wed Jun 29 10:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-98468437 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:21:42.549807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:42.550595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:42.557081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:42.557616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:42.558454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:42.559001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:42.690737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:42.699465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c80ac1e3-dd51-411a-9f2d-fe6e180f71d4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.154086 Jun 29 10:21:42.700070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 754/1586] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:42 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:42.888961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:42.889474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:42.898945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:42.899482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:42.900271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:42.900677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:42.986779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:42.995982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:42.997476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:42.998680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f605afcb-84a9-4db2-a978-5d0cff2ca5fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.113857 Jun 29 10:21:42.999244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 833/1587] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:43.247489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:43.248066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:43.257980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:43.258435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:43.259249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:43.259682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:43.401598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:43.410332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-79c25d5e-3d06-41db-9b54-f04486fbd490 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169173 Jun 29 10:21:43.410961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 755/1588] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:43.721064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:43.722040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:43.729799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:43.730223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:43.731025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:43.731492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:43.874408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:43.883093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9ead330-a117-4334-bbc0-c4da94722af3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168378 Jun 29 10:21:43.883910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 834/1589] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:43 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:44.020485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:44.021098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:44.027953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:44.028398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:44.029160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:44.029590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:44.092802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:44.101914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:44.103439 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:44.104598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e7162c8-9c06-46b8-a9ee-e5d07008cfe3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091090 Jun 29 10:21:44.105137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 756/1590] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:44.429436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:44.430052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:44.437209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:44.437653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:44.438422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:44.438881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:44.587495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:44.600995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-52ba759d-a4b4-4a14-8136-c731f9d60103 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.176468 Jun 29 10:21:44.601584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 835/1591] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:44 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:44.902869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:44.903495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:44.910397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:44.910914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:44.911705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:44.912125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:45.049164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:45.060805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59cf61a8-ebd9-4983-bb95-13c3d0b10607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161881 Jun 29 10:21:45.061387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 757/1592] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:44 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:21:45.128464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:45.129211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:45.136326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:45.136799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:45.137532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:45.138084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:45.202602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:45.211877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:45.213349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:45.214508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-44136800-1abf-4b41-b141-6f75b88224bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092880 Jun 29 10:21:45.215100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 836/1593] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:45.620095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:45.620610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:45.627177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:45.627625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:45.628383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:45.628819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:45.632717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:45.780435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:45.792370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc578b59-d65f-437f-8cfa-e9476e3bbd02 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.176686 Jun 29 10:21:45.793177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 758/1594] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:46.078746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:46.079364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:46.086607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:46.087093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:46.087869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:46.088296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:46.232899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:46.233477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:46.239720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:46.241686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:46.242117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:46.242924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:46.243350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:46.248631 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8cbdf921-e6fa-4ae7-a45a-9d6f8d976483 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173740 Jun 29 10:21:46.249217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 837/1595] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:46 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:46.316119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:46.325506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:46.327027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:46.328185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9105e428-2be8-48a1-8e7d-b4df65a09b4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099415 Jun 29 10:21:46.328780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 759/1596] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:46.817899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:46.818874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:46.827563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:46.828012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:46.828776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:46.829209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:46.967441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:46.976091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d8fb8a26-318f-4a4c-8be1-60da87ee529c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164872 Jun 29 10:21:46.976692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 838/1597] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:47.266546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:47.267186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:47.274500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:47.274989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:47.275734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:47.276210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:47.346769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:47.347419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:47.355242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:47.355692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:47.356470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:47.356906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:47.411221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:47.420690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a02aa97-e3d6-4aa7-b390-5489eeba7a0b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158089 Jun 29 10:21:47.421282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 760/1598] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:47 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:47.422503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:47.424864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:47.432516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:47.434009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:47.435196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-25b763d6-c639-47ab-bb3c-6d9e30e2a374 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092410 Jun 29 10:21:47.435754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 839/1599] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:47.993786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:47.994409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:48.001028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:48.001482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:48.002458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:48.002932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:48.139869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:48.148448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cf749d02-aae7-4b34-873e-049526e16086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.158875 Jun 29 10:21:48.149028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 761/1600] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:48.438663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:48.439252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:48.447412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:48.447882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:48.449345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:48.449867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:48.453625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:48.454276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:48.461453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:48.461909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:48.462761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:48.463197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:48.526528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:48.535464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:48.536985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:48.538897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ccc5b78-e467-4ace-b271-3bbf43b0cf4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088739 Jun 29 10:21:48.539813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 762/1601] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:48.601214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:48.614288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-478976ae-cf3f-4524-a948-23256515519d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179192 Jun 29 10:21:48.615219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 840/1602] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:48 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:49.166481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:49.167024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:49.173818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:49.174272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:49.175082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:49.175517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:49.327948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:49.339761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-809a0585-bc7a-4c3d-9aaf-2fa0ed7eb0b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.175923 Jun 29 10:21:49.339761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 763/1603] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:49 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:49.558595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:49.559205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:49.561500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:49.567574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:49.568014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:49.568778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:49.569204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:49.638391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:49.639097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:49.639866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:49.645903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:49.646400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:49.648673 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:49.649124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:49.649236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:49.650741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:49.651914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2469e7e7-748a-408c-9b14-8ccbf9e2ab02 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097929 Jun 29 10:21:49.652684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 841/1604] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:49.788426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:49.796683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-607234e2-4960-4176-a902-e279363b3f05 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167940 Jun 29 10:21:49.797249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 764/1605] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:49 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:50.360843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:50.361361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:50.367991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:50.368446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:50.369230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:50.369664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:50.501618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:50.510263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c49132eb-a786-469c-b7bf-adad869e2b6f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.153475 Jun 29 10:21:50.510879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 842/1606] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:50.681315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:50.682167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:50.693001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:50.693709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:50.694777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:50.695211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:50.763209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:50.774871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:50.776411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:50.777604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4521dc5b-acb3-4099-b8ac-0b358157a088 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103475 Jun 29 10:21:50.778187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 765/1607] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:50.820634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:50.821245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:50.831314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:50.831955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:50.833109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:50.833712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:50.972882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:50.984291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-59f670d9-fbc8-4f1e-b777-ed3fa213ebbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169533 Jun 29 10:21:50.985080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 843/1608] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:50 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:51.533719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:51.534397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:51.543111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:51.543566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:51.544607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:51.545077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:51.689754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:51.699472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e119cd10-4eb1-4f52-ba3d-8b1f0aa84f04 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171942 Jun 29 10:21:51.700072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 766/1609] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:51 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:51.796876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:51.797453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:51.805051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:51.805498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:51.806261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:51.806732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:51.879514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:51.888718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:51.890191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:51.891368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-063102ec-bb1c-4e97-ab2a-28e081ffa7fc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098650 Jun 29 10:21:51.891920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 844/1610] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:52.007079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:52.007464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:52.013954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:52.014404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:52.015203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:52.016107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:52.156433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:52.166920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7c0ece8b-0a59-41a4-8dbe-4a86b27877aa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166497 Jun 29 10:21:52.167508 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 767/1611] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:52.723042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:52.723821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:52.731786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:52.732394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:52.733161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:52.733574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:52.880601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:52.889075 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b71f12c7-9e74-4cdf-86fa-e6bfec54d6f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.172051 Jun 29 10:21:52.889670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 845/1612] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:52.909419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:52.910019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:52.917587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:52.918042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:52.918857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:52.919297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:52.982446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:52.991599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:52.993935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:52.995358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75ce70e4-2311-464a-9bbe-b78441eb219e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089884 Jun 29 10:21:52.995944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 768/1613] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:53.186019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:53.186913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:53.196796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:53.197262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:53.198067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:53.198511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:53.340712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:53.348928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a3dcc275-dca1-4f4e-b516-d234b544286f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168427 Jun 29 10:21:53.349468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 846/1614] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:53.906677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:53.907320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:53.914457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:53.915121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:53.915790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:53.916235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:54.013644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:54.014230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:54.020535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:54.020981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:54.021740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:54.022168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:54.063795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:54.073156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-078a0a4b-c6c6-4c7c-82a5-8c763adf010d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171335 Jun 29 10:21:54.073788 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 769/1615] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:54.095219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:54.104661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:54.106135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:54.107322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e23fb90e-3d51-49fa-ab47-60e7202b486a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097855 Jun 29 10:21:54.107879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 847/1616] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:21:54.373239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:54.373992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:54.383296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:54.383765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:54.384523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:54.384952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:54.519573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:54.528789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-be6a1bac-1c07-4daf-8c3f-a5dbfc2599d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161509 Jun 29 10:21:54.529358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 770/1617] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:54 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:55.090872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:55.091493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:55.098613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:55.099100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:55.099868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:55.100306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:55.125431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:55.126818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:55.134901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:55.135457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:55.136304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:55.136823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:55.202467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:55.211877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:55.213385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:55.214691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b66b0c9-95c9-4a68-a0c8-b7398c99dc5a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093106 Jun 29 10:21:55.215261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 771/1618] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:55.245835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:55.257533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a8559931-dc3e-45e5-bea7-9270c7b2ea31 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170444 Jun 29 10:21:55.258184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 848/1619] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:55 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:55.545739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:55.546349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:55.553236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:55.553720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:55.554485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:55.554995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:55.704592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:55.717879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8aea03b8-d31d-44a6-8b0f-a55bef243b2f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.175868 Jun 29 10:21:55.718783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 772/1620] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:55 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:56.234153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:56.234831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:56.242236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:56.242615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:56.243428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:56.243867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:56.279772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:56.280414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:56.287262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:56.287714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:56.288490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:56.288931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:56.310682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:56.319830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:56.321318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:56.322637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-710262eb-95c4-4591-bc54-f70f243435b8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092431 Jun 29 10:21:56.323210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 849/1621] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:56.428785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:56.437434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e1995c07-d68a-4db8-b8b8-43f360e93ceb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161877 Jun 29 10:21:56.438006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 773/1622] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:56 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:56.743191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:56.744195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:56.751689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:56.752142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:56.752920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:56.753353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:56.898001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:56.906598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e11fc6bd-6837-4cb4-a8bd-470f1789e489 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169949 Jun 29 10:21:56.907199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 850/1623] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:57.348576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:57.349188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:57.358142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:57.358601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:57.359399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:57.359851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:57.428675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:57.431898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:21:57.440365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:57.441842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:57.443390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7d716349-f5f7-4a12-ad7d-b6c414e43009 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101208 Jun 29 10:21:57.443958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 774/1624] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:57.456303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:57.456962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:57.467109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:57.467568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:57.468349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:57.468775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:57.619670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:57.628180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cfe011b6-f825-4f49-ba69-2930c0c58ac5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.176557 Jun 29 10:21:57.628775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 851/1625] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:57 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:57.930921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:57.931538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:57.940410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:57.941028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:57.942430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:57.943064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:58.084774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:58.093205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7eb2e2f3-df88-4e10-9f2c-d7b66cac4c90 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168172 Jun 29 10:21:58.093776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 775/1626] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:57 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:58.462750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:58.463398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:58.470444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:58.470927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:58.471692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:58.472133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:58.534057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:58.542775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:58.544505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:58.545632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc0ffe43-854c-4111-86a7-e3d13f523f9b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.086933 Jun 29 10:21:58.546196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 852/1627] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:58.653485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:58.654411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:58.664185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:58.664907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:58.666045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:58.666714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:58.803801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:58.812370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12e15a29-0034-4d38-871a-6294255c1b5f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165015 Jun 29 10:21:58.812949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 776/1628] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:59.110719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:59.111315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:59.117828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:59.118284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:59.119166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:59.119611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:59.273410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:59.286540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-477802fe-66f6-404b-8642-35a320206914 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179513 Jun 29 10:21:59.287325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 853/1629] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:21:59.567649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:59.568468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:59.577082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:59.577532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:59.578291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:59.578788 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:59.649115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:59.658441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:59.660012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:21:59.661135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6d8309c-e27a-460b-97c9-2cc6d67e5942 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100581 Jun 29 10:21:59.661695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 777/1630] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:21:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:21:59.833672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:21:59.834426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:21:59.843532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:59.843983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:59.844741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:21:59.845171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:21:59.996509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:00.004920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ad0d83db-8f31-4129-a6e1-d7eff7e33e2c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.177584 Jun 29 10:22:00.005491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 854/1631] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:21:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:00.308805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:00.309693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:00.319256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:00.319934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:00.321196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:00.321777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:00.476416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:00.486811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb58a287-3a32-49d3-897f-87e4aadeaae2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.184089 Jun 29 10:22:00.487311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 778/1632] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:00.680566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:00.681213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:00.688361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:00.688791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:00.690041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:00.690647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:00.756894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:00.765832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:00.767353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:00.768505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-357cc9f8-8c92-4913-ac2f-d359e16a9f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091945 Jun 29 10:22:00.769060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 855/1633] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:01.022907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:01.023484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:01.030753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:01.031229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:01.031998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:01.032437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:01.189897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:01.201349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4db18a3-5782-4106-aa22-8d2a23e9ac0e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.182576 Jun 29 10:22:01.201933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 779/1634] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:01 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:01.506707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:01.507579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:01.514626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:01.515113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:01.515895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:01.516338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:01.538280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:01.657733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:01.666137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef73f4c9-4f40-44cb-9e45-a24bc82ea29b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165049 Jun 29 10:22:01.666938 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 856/1635] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:01 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:01.786767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:01.787288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:01.794240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:01.794718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:01.795491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:01.795921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:01.861744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:01.871775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:01.873483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:01.874682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-23118667-1966-458e-803d-613ede8998aa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092075 Jun 29 10:22:01.875234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 780/1636] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:02.219230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:02.219806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:02.227863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:02.228415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:02.229464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:02.230692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:02.375164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:02.388390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a8f6a83-2479-4301-bb83-e7e251a54c1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.172801 Jun 29 10:22:02.388928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 857/1637] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:02 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:02.686013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:02.686652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:02.697040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:02.697544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:02.698712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:02.699244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:02.836207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:02.845184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3b74fd03-f555-431a-90f8-ce9651cf0d00 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165329 Jun 29 10:22:02.845834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 781/1638] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:02.893557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:02.894201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:02.901415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:02.901862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:02.902734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:02.903270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:02.974169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:02.984335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:02.985826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:02.987000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8e762700-5fae-4c19-a0fb-c544ed05222f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097447 Jun 29 10:22:02.987564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 858/1639] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:03.411947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:03.412463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:03.419866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:03.420345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:03.421113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:03.421541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:03.576888 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:03.585268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2846e858-b51f-4c21-bb03-d2861de17b3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.177326 Jun 29 10:22:03.585897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 782/1640] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:03 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:03.864373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:03.864988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:03.874918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:03.875476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:03.876254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:03.876689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:04.005607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:04.006248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:04.013294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:04.013749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:04.014581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:04.015034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:04.039780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:04.048506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-debccba4-d8b7-4fa8-968f-c0dcbee320c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.189370 Jun 29 10:22:04.049101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 859/1641] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:03 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:04.083048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:04.091914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:04.093415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:04.094585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f6597a52-a30f-4313-b7b6-20ba842e3602 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092978 Jun 29 10:22:04.095145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 783/1642] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:04.603033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:04.603963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:04.612037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:04.612568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:04.613344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:04.613788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:04.761694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:04.769899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-beace461-338d-4434-896d-929a2a79b413 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171664 Jun 29 10:22:04.770456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 860/1643] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:04 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:05.066077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:05.066714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:05.076390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:05.076865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:05.077638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:05.078082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:05.113050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:05.113689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:05.120843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:05.121650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:05.122672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:05.123131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:05.189021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:05.198260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:05.200619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:05.201755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f1e387a6-506d-4832-9198-05145b1f1ed2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092710 Jun 29 10:22:05.202356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 861/1644] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:05.223369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:05.231978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2023c69c-723c-4891-95fd-7ba2f10ceb4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169665 Jun 29 10:22:05.232812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 784/1645] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:05 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:05.788014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:05.788620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:05.795864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:05.796312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:05.797077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:05.797508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:05.941558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:05.950711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4f18c42-5870-4716-a1bb-86ffe4b34c60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166661 Jun 29 10:22:05.951298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 862/1646] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:06.223611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:06.224243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:06.234616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:06.235163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:06.236345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:06.236952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:06.254272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:06.254881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:06.262185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:06.262674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:06.263474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:06.263893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:06.303318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:06.313054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:06.314747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:06.315890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-46b0a777-7120-4961-beee-b58af3afdcec tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098390 Jun 29 10:22:06.316441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 785/1647] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:06.401946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:06.415524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3290ff41-6f76-44d1-9b50-2fbb7b3478de tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164953 Jun 29 10:22:06.416329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 863/1648] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:06 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:06.969034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:06.969657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:06.976063 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:06.976507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:06.977262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:06.977689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:07.130142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:07.140650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c97c1fdb-c2fa-4cdc-b79b-31a11f443f55 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.176139 Jun 29 10:22:07.141213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 786/1649] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:07.335998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:07.336605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:07.343926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:07.344379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:07.345152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:07.345620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:07.407352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:07.415995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:07.417483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:07.418872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-22611ca3-3932-4e3a-ae03-ca4ccf21dad4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087104 Jun 29 10:22:07.419328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 864/1650] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:07.433319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:07.434100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:07.441188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:07.441636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:07.442807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:07.443238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:07.578210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:07.586497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9a6ac3b3-540f-4c31-b68d-3a303d615726 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157058 Jun 29 10:22:07.587090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 787/1651] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:07 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:08.165069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:08.165683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:08.172270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:08.172725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:08.173497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:08.173935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:08.316058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:08.328752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-528ae869-b5fc-40a7-b2e8-027a20419b23 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167443 Jun 29 10:22:08.329386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 865/1652] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:08.438069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:08.438704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:08.441032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:08.447259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:08.447717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:08.448500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:08.448925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:08.518236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:08.527293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:08.528930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:08.530081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a396e10a-4b14-4217-bcde-eff8d7128e22 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096338 Jun 29 10:22:08.530632 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 788/1653] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:08.604837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:08.605726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:08.612894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:08.613402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:08.614238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:08.614639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:08.750231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:08.758725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-68b178eb-1998-4919-820e-8bdd79b98d76 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157876 Jun 29 10:22:08.759303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 866/1654] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:08 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:09.345940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:09.346523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:09.353304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:09.353868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:09.354684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:09.355133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:09.500258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:09.513009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81991842-7d95-417d-b4f3-afad9633a34d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170754 Jun 29 10:22:09.513592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 789/1655] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:09 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:09.548955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:09.549993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:09.558002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:09.558635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:09.559704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:09.560303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:09.627162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:09.635563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:09.637058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:09.638375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4451900c-f5c5-45a5-92c4-4358a275d87f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093479 Jun 29 10:22:09.639049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 867/1656] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:09.776955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:09.777610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:09.784833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:09.785279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:09.786036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:09.786471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:09.933681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:09.944060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de900ef5-84b3-4749-a686-195bb321a947 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171318 Jun 29 10:22:09.944671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 790/1657] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:10.532716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:10.533458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:10.539927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:10.540390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:10.541143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:10.541578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:10.656857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:10.657446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:10.664526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:10.664977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:10.665727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:10.666153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:10.682214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:10.696791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:10.705022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-01dc58d9-d9a6-49f5-a39f-47676c01cf45 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.177282 Jun 29 10:22:10.705595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 868/1658] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:10 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:10.732706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:10.745997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:10.748059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:10.749209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d1ed8a01-1bbd-4286-95f8-200f16a80ece tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097002 Jun 29 10:22:10.749761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 791/1659] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:10.962180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:10.962921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:10.969925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:10.970371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:10.971172 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:10.971566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:11.115851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:11.129412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e460167-ff95-4867-a2d4-3091a54a534d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170655 Jun 29 10:22:11.130111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 869/1660] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:10 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:11.724561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:11.725418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:11.734119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:11.734603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:11.735383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:11.735818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:11.767328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:11.767947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:11.774975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:11.775467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:11.776277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:11.776713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:11.843373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:11.852174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:11.853704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:11.854904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bf3ccf64-fed3-4612-98b3-0aee8284acfb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091484 Jun 29 10:22:11.855439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 870/1661] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:11.873088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:11.882210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a191a403-8818-471f-a465-72601a680f8e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163206 Jun 29 10:22:11.882779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 792/1662] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:12.150066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:12.150753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:12.157281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:12.157731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:12.158535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:12.159000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:12.298153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:12.306626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a30899b-5f49-4b6d-a47e-0cfd596cb0f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160836 Jun 29 10:22:12.307124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 871/1663] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:12 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:12.875134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:12.875765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:12.882895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:12.883377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:12.884159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:12.884576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:12.900231 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:12.900830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:12.908355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:12.908804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:12.909575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:12.909974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:12.949105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:12.958813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:12.960299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:12.961453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60dd1a05-6529-4c2b-bc75-f022b9dbb034 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091660 Jun 29 10:22:12.962010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 793/1664] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:13.040120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:13.049281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e20081c2-c7f9-4e9c-8735-1e24ce04c1a0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.153094 Jun 29 10:22:13.056476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 872/1665] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:12 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:22:13.324334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:13.324938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:13.331837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:13.332280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:13.333031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:13.333453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:13.478486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:13.491170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-17f911e0-f815-42a0-a09e-dcf1ed4c1391 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170405 Jun 29 10:22:13.491949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 794/1666] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:13 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:22:13.980457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:13.981072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:13.988309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:13.988760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:13.989527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:13.989951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:13.992561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:14.064803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:14.067751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:14.068373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:14.074115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:14.074556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:14.075043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:14.075642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:14.075852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:14.076285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:14.076828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1deab854-8f65-4814-9ac1-80ccc3572948 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100452 Jun 29 10:22:14.077361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 873/1667] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:14.221399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:14.230102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93b5704b-77b1-4a4a-b0a9-59de80e74c7b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167247 Jun 29 10:22:14.230768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 795/1668] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:14 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:14.514325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:14.515047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:14.524256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:14.524882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:14.526085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:14.526621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:14.668182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:14.678112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9311428d-a827-4dc0-b34d-baa896c19a4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170030 Jun 29 10:22:14.678719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 874/1669] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:14 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:15.099875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:15.100486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:15.107916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:15.108376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:15.109153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:15.109650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:15.186289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:15.196099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:15.197569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:15.198760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-80dd9282-0a83-4d92-b36f-127ded064aee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.107204 Jun 29 10:22:15.199292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 796/1670] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:15.249101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:15.249715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:15.256819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:15.257272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:15.258041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:15.258472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:15.396096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:15.404549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fae7e044-1326-4a45-b2df-c63a182e9c3f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159347 Jun 29 10:22:15.405123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 875/1671] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:15 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:15.697007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:15.697639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:15.704259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:15.704717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:15.705482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:15.705906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:15.846342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:15.855141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee383b57-3e21-4556-baa4-dfe49829c94f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162262 Jun 29 10:22:15.855733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 797/1672] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:15 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:16.220132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:16.220871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:16.229833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:16.230398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:16.231616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:16.232277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:16.313184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:16.322501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:16.324076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:16.325215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-30d2cff1-8f91-4eaa-87e8-a3fc71ec1d68 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.109650 Jun 29 10:22:16.325771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 876/1673] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:16.430934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:16.431585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:16.439054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:16.439501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:16.440256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:16.440681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:16.595925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:16.604320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10ed3179-2e64-49dd-aa3f-4a3fc274a503 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.179136 Jun 29 10:22:16.604913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 798/1674] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:16.878965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:16.879455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:16.886329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:16.886803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:16.887563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:16.887988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:17.026178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:17.038490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ba9ec80b-943f-4b31-a452-588dc16491a9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164040 Jun 29 10:22:17.039467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 877/1675] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:16 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:17.343658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:17.344985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:17.351803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:17.352250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:17.353056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:17.353474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:17.424861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:17.433813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:17.435333 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:17.436474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa2ef86d-4257-41e2-a749-1067de74c306 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096821 Jun 29 10:22:17.437008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 799/1676] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:17.622358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:17.622974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:17.630685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:17.631135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:17.631870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:17.632299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:17.771490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:17.779469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-103137cc-9516-4f63-879b-baa8ce94b748 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161177 Jun 29 10:22:17.780038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 878/1677] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:18.058371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:18.059017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:18.066488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:18.067337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:18.068110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:18.068546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:18.212663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:18.223721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-44b4eefe-6c90-42c7-8832-d92c249e3926 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169303 Jun 29 10:22:18.224302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 800/1678] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:18 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:18.457074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:18.457685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:18.465641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:18.466106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:18.466926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:18.467364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:18.533297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:18.542323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:18.543882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:18.545001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9e3113bb-4bdb-4051-904d-87482a8e33f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092448 Jun 29 10:22:18.545562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 879/1679] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:18.800150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:18.800711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:18.810181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:18.810791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:18.811882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:18.812489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:18.955014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:18.963770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b16fc59-2fbd-480b-af2c-a7e57c53812c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169801 Jun 29 10:22:18.964348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 801/1680] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:19.243952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:19.244592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:19.254645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:19.255368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:19.256412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:19.256987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:19.396676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:19.405009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8ff3d2cc-e58b-4335-8ff1-a247859cedc6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167302 Jun 29 10:22:19.405560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 880/1681] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:19 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:19.564387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:19.565036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:19.573151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:19.573612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:19.574408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:19.574882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:19.644155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:19.652991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:19.654538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:19.655731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-135fa1b5-bbda-4db7-9dd5-7683b80c75c9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095499 Jun 29 10:22:19.656287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 802/1682] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:19.980924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:19.981575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:19.983505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=80 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:19.989318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:19.989772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:19.990539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:19.991009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:20.126735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:20.137578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-83404574-086f-4e27-9bf2-242fa78f0c09 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160258 Jun 29 10:22:20.138501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 881/1683] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:20.423345 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:20.423929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:20.431193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:20.431741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:20.432753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:20.433299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:20.570240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:20.579688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f3c088c-9ae3-48bf-80d8-9e3827c64df5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160865 Jun 29 10:22:20.580257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 803/1684] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:20 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:20.675886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:20.676469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:20.683268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:20.683724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:20.684486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:20.684928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:20.754045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:20.772462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:20.773996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:20.775184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a8e9fd08-976c-4a52-b1dd-6772a7fea9da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103970 Jun 29 10:22:20.775745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 882/1685] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:21.157142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:21.157795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:21.164407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:21.164860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:21.165614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:21.166044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:21.298049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:21.306839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8edd2206-e002-4fa8-ba35-a1df7787c8cd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.154324 Jun 29 10:22:21.307425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 804/1686] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:21.599917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:21.600813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:21.609229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:21.609853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:21.610893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:21.611324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:21.753683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:21.762185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-13687001-c3d4-41e3-ab46-940aa5489c69 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168195 Jun 29 10:22:21.762815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 883/1687] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:21 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:21.796966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:21.797728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:21.807146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:21.807727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:21.808852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:21.809390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:21.884981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:21.897783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:21.899884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:21.901353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc85f653-2fac-4fb6-a1d7-7dcb140ccc71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.109922 Jun 29 10:22:21.902069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 805/1688] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:22.325979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:22.326598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:22.333698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:22.334149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:22.334962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:22.335398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:22.465708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:22.474249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-710b5319-aa2f-4e81-86a1-76707215ef46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.152125 Jun 29 10:22:22.474739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 884/1689] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:22 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:22.780839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:22.781525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:22.789036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:22.789559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:22.790486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:22.791000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:22.920913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:22.921638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:22.928860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:22.929280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:22.929800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:22.930321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:22.930547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:22.938180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-31c618f4-c470-4008-9aab-3a4e6bc8b57a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161870 Jun 29 10:22:22.938979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 806/1690] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:22 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:22.998586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:23.007655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:23.009116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:23.010297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-77534ece-9cf0-495c-b34b-63696642fe49 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093425 Jun 29 10:22:23.010891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 885/1691] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:22:23.495936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:23.496540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:23.503621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:23.504102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:23.504941 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:23.505348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:23.644414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:23.652564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b013d56b-7b0f-4671-81ec-523bf7d4a388 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160609 Jun 29 10:22:23.653133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 807/1692] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:23.959413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:23.960117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:23.968977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:23.969562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:23.970708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:23.971238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:24.028903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:24.029554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:24.036494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:24.036948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:24.037722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:24.038163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:24.042473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:24.106811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:24.111559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:24.117284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:24.119076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:24.119865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5ad6141e-c8ba-4e72-b147-872ae700c3cc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166136 Jun 29 10:22:24.120386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9e0eb4da-5c36-4fe6-850e-411277022038 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095501 Jun 29 10:22:24.120492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 886/1693] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:23 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:24.120961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 808/1694] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:24.676126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:24.676768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:24.683974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:24.684452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:24.685294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:24.685777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:24.831345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:24.839926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-68ac2841-d714-4a7d-83c1-3b9f39e0000a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167911 Jun 29 10:22:24.840517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 887/1695] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:25.139076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:25.140599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:25.142668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:25.143865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:25.149299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:25.149826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:25.151092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:25.151239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:25.151348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:25.151446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:25.151757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:25.152184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:25.220361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:25.229101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:25.230641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:25.231794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eeb1d064-7a08-408d-9d2a-1ac038e57f34 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094460 Jun 29 10:22:25.232374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 888/1696] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:25.287203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:25.299324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37ef0a09-72a4-43cf-bfdb-9662e17874bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164982 Jun 29 10:22:25.299927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 809/1697] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:25 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:25.857621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:25.858224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:25.865058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:25.865507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:25.866259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:25.866708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:26.004066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:26.006379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:26.014091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eea7bacc-1e7c-4c48-bd66-c4246ee14ae7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160290 Jun 29 10:22:26.014771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 889/1698] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:25 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:26.253235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:26.253805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:26.260861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:26.261293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:26.262069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:26.262505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:26.317214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:26.318166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:26.325269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:26.325697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:26.326465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:26.326921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:26.335269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:26.343833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:26.345329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:26.347241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ca7bc56-4826-439f-bef4-5f7f5909353f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099860 Jun 29 10:22:26.347841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 810/1699] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:26.461542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:26.469725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c4967273-e144-4308-92bc-a5f8d6bfe6b5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157202 Jun 29 10:22:26.470286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 890/1700] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:26 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:27.031792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:27.032408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:27.040271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:27.040733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:27.043478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:27.044018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:27.187829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:27.196835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9d549fc3-1fbf-42b6-95f9-949fc5ff0627 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168950 Jun 29 10:22:27.197408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 811/1701] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:27.366590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:27.367146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:27.374164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:27.374601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:27.375411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:27.375837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:27.448101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:27.457342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:27.458876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:27.460027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f9fb3690-ee79-4c25-9594-6fb540a92fef tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097753 Jun 29 10:22:27.460586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 891/1702] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:27.491057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:27.491645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:27.498742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:27.499192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:27.499962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:27.500403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:27.641418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:27.656206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e6a690ed-8c17-4bbe-9a9a-2f6174c29cad tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168818 Jun 29 10:22:27.657145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 812/1703] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:27 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:28.214676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:28.215287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:28.222191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:28.222866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:28.223763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:28.224278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:28.366542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:28.380106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa670d8f-dd65-4f48-a4d7-ac6dbddf9617 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169473 Jun 29 10:22:28.380703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 892/1704] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:28.481319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:28.482135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:28.491431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:28.492062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:28.492905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:28.493449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:28.562769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:28.572346 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:28.573853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:28.575057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-512565e7-6c6f-476e-b262-0befcbde6e76 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100292 Jun 29 10:22:28.575616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 813/1705] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:28.677010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:28.677943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:28.687763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:28.688477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:28.689625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:28.690311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:28.842961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:28.854702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f15a4817-81d3-4a3a-b320-899c125ce7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.181972 Jun 29 10:22:28.855385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 893/1706] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:28 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:29.402313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:29.402976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:29.409408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:29.409857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:29.410659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:29.411174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:29.561492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:29.570408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8825281a-f606-4e62-be05-43ca4d7a3666 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171996 Jun 29 10:22:29.571029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 814/1707] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:29 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:29.595160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:29.595771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:29.602913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:29.603361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:29.604126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:29.604560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:29.675371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:29.684166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:29.685653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:29.686848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-14655bb3-dd29-423c-9cc4-c7ca0350e5b9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095727 Jun 29 10:22:29.687404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 894/1708] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:29.874900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:29.875535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:29.882397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:29.882878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:29.883637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:29.884068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:30.027370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:30.038817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad3439d6-834e-4938-91c2-367e9be24327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167875 Jun 29 10:22:30.039414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 815/1709] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:29 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:30.592959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:30.593568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:30.600756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:30.601374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:30.601958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:30.602405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:30.705773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:30.706373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:30.713153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:30.713614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:30.714377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:30.714843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:30.744972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:30.753867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e4165830-178b-45e8-8860-fae0a0887189 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164769 Jun 29 10:22:30.754459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 895/1710] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:30.783544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:30.792930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:30.794416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:30.795610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d42a8ffe-c9b5-44d0-977d-d9f94a9862b6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093880 Jun 29 10:22:30.796170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 816/1711] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:31.058500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:31.059555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:31.067422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:31.068216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:31.069002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:31.069459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:31.221879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:31.233853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-22a0ecf2-f691-4441-b21d-3fd4a8ece851 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179371 Jun 29 10:22:31.234645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 896/1712] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:31 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:31.772173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:31.772779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:31.779913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:31.780364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:31.781134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:31.781573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:31.814651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:31.815766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:31.825827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:31.826350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:31.827206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:31.828440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:31.896741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:31.905894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:31.907354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:31.908539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9978bb8-580a-458b-8a8b-ba056ce3b489 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099026 Jun 29 10:22:31.909110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 897/1713] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:32.172706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:32.182154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4bdaa94-7dc2-4f52-8261-61abc1ead554 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.414099 Jun 29 10:22:32.182952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 817/1714] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:32.256450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:32.257057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:32.263654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:32.264102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:32.264839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:32.265290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:32.400508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:32.410136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-51db1483-281c-43ed-94c6-e21ca6e39d68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159653 Jun 29 10:22:32.410733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 898/1715] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:32 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:32.927164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:32.927918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:32.934884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:32.935331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:32.936105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:32.936536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:33.002841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:33.014387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:33.016782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:33.018307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9ec939ef-1fc0-4871-a3f0-4eb744c5e1a5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095495 Jun 29 10:22:33.019038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 818/1716] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:33.200108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:33.200736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:33.207745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:33.208465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:33.209205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:33.209634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:33.351576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:33.363647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c653f5f4-3b93-4488-b57e-2cba251ee238 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167036 Jun 29 10:22:33.364098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 899/1717] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:33 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:33.426952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:33.427559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:33.434741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:33.435177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:33.435970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:33.436462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:33.575164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:33.585863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-75508f9b-4de0-471c-b9bf-fb2621cf4677 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162889 Jun 29 10:22:33.586443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 819/1718] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:33 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:34.036169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:34.036783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:34.043668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:34.044105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:34.044888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:34.045324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:34.111878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:34.121010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:34.122505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:34.123687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5916d5a9-5a79-41d5-834d-3b2de62cd5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091593 Jun 29 10:22:34.124254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 900/1719] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:34.382664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:34.383263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:34.390188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:34.390653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:34.391438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:34.391867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:34.545392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:34.555832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-17e11dc3-0671-49e3-9167-5fefda8be3bb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.178548 Jun 29 10:22:34.556662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 820/1720] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:34.605895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:34.606513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:34.613656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:34.614105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:34.614915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:34.615682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:35.018079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:35.026322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-11ee0016-c84f-4a93-a950-161156b2dbaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.424382 Jun 29 10:22:35.026937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 901/1721] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:34 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:35.142094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:35.142724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:35.149993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:35.150452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:35.151286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:35.151727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:35.227958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:35.237209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:35.238755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:35.239949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b79a46d-d219-4d84-ab2b-ec0eb9771d04 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102326 Jun 29 10:22:35.241426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 821/1722] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:35.579538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:35.580024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:35.586799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:35.587248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:35.588041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:35.588769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:35.733648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:35.744284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb92982f-e8d3-48b9-ad91-ea91658ed5ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170151 Jun 29 10:22:35.744857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 902/1723] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:35 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:36.044419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:36.045066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:36.052362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:36.052867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:36.053766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:36.054200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:36.193879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:36.203052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e48ed945-b0ec-49e0-b990-49a7b9ff1e9b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162605 Jun 29 10:22:36.203624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 822/1724] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:36 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:36.261957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:36.262586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:36.269653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:36.270653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:36.271441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:36.271882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:36.349626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:36.364158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:36.366834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:36.368371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e47fdcb3-a0ff-4efc-81cc-50fe396a6593 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.110419 Jun 29 10:22:36.368932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 903/1725] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:36.762428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:36.763130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:36.770287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:36.770861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:36.771681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:36.772410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:36.918334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:36.929856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a9c10b62-70f9-4bad-8ecf-216e795bf1ba tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.171620 Jun 29 10:22:36.930414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 823/1726] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:36 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:37.223573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:37.224297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:37.234076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:37.234667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:37.235766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:37.236329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:37.371153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:37.379487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f5eeb38c-17a5-4b22-9757-8ddbfc4c43a2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162160 Jun 29 10:22:37.380015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 904/1727] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:37 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:37.386963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:37.387661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:37.394755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:37.395209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:37.395974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:37.396413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:37.467003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:37.469220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:37.477069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:37.478578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:37.479751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b1cf438-d4e2-40f5-8d64-ebca925fbfc5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096771 Jun 29 10:22:37.480357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 824/1728] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:37.956622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:37.957476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:37.965724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:37.966173 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:37.966964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:37.967385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:38.112892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:38.124830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ba12a16d-e1ce-4351-ac12-3b0d13d246ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173995 Jun 29 10:22:38.125666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 905/1729] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:38.398610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:38.399274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:38.406702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:38.407150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:38.407940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:38.408369 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:38.498128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:38.498805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:38.505702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:38.506119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:38.507329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:38.507906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:38.524784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:38.557094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:38.565264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4aa8d855-fc7e-4f15-9203-bb6ac1c6755d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171429 Jun 29 10:22:38.565836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 825/1730] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:38 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:38.573803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:38.585262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:38.586794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:38.587997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-54e33801-02b5-4f33-8321-ec82ced07cca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093997 Jun 29 10:22:38.588609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 906/1731] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:39.144282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:39.144811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:39.146710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=76 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:39.152618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:39.153065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:39.153870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:39.154305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:39.297926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:39.306694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e4d21c9-af99-43be-a07f-2eca26fe6a3b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166440 Jun 29 10:22:39.307296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 826/1732] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:39.586263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:39.586909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:39.595545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:39.596000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:39.596969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:39.597438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:39.605953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:39.606546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:39.613760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:39.614217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:39.614989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:39.615434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:39.678855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:39.688470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:39.689970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:39.691163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-896b233e-271e-481c-8617-f231b06fdf72 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089619 Jun 29 10:22:39.692115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 827/1733] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:39.729505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:39.738138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a516d70a-8d94-45c3-81af-4d74e53f465b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157977 Jun 29 10:22:39.738734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 907/1734] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:39 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:40.324045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:40.324580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:40.331370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:40.331817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:40.332581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:40.333010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:40.477940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:40.489912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e21ccb8-7302-43b3-a1bf-19a73a5cbfcc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169713 Jun 29 10:22:40.490710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 828/1735] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:40.710212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:40.710976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:40.718108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:40.718557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:40.719451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:40.719875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:40.755463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:40.756118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:40.763359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:40.763835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:40.764617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:40.765052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:40.785825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:40.795936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:40.797449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:40.798697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-61a6bfb1-4397-4c82-8465-fd7b4442a7b2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092608 Jun 29 10:22:40.799532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 908/1736] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:40.904187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:40.912494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-65d8dd3f-738a-4e71-8897-5427334c9c9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160935 Jun 29 10:22:40.913419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 829/1737] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:41.510617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:41.511402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:41.520641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:41.521313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:41.522458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:41.523263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:41.672572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:41.681784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8233057e-e238-453e-ad41-38c12cf4ba65 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.177305 Jun 29 10:22:41.682351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 909/1738] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:41 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:41.821204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:41.821777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:41.828695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:41.829140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:41.829898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:41.830324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:41.893269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:41.902252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:41.903812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:41.904971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f020df7a-dab0-4cf7-a7e3-996f3b9397f9 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090383 Jun 29 10:22:41.905565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 830/1739] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:41.934965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:41.935588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:41.942538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:41.943061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:41.943833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:41.944264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:42.081837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:42.094451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0ba5e3a3-cf2e-4aa9-bd81-355a084e70d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163185 Jun 29 10:22:42.095285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 910/1740] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:41 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:42.700709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:42.701429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:42.708375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:42.708828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:42.709590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:42.710980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:42.851135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:42.859476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-833fd299-efe7-43cb-a31c-6a253a4d0a46 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163144 Jun 29 10:22:42.860040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 831/1741] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:42 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:42.926203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:42.927011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:42.934351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:42.934831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:42.935602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:42.936191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:43.005113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:43.014018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:43.015562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:43.016752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-042bb0b2-8e20-482b-b5eb-8a6013533363 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096771 Jun 29 10:22:43.017309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 911/1742] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:43.114193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:43.114833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:43.121442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:43.121891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:43.122693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:43.123116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:43.257562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:43.270455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-87dd3889-4b06-4d14-a0f3-6b754dfb3a55 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160001 Jun 29 10:22:43.271363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 832/1743] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:43 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:43.877657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:43.878258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:43.885151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:43.885604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:43.886372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:43.886850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:44.038426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:44.039302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:44.047760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:44.048692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:44.049698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:44.049921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:44.120487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:44.129291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:44.130811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:44.131999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-125f017b-60bb-4523-beed-dc49946bd00a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099730 Jun 29 10:22:44.132580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 833/1744] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:44.199741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:44.208284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1820957d-b9a3-4dce-8019-13b8c663ed95 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.334553 Jun 29 10:22:44.208884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 912/1745] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:44.293806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:44.294328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:44.300873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:44.301321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:44.302096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:44.302523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:44.446411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:44.455832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-29034aaa-3451-483b-8bfd-ced19f102174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166011 Jun 29 10:22:44.456396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 834/1746] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:44 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:45.153356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:45.153964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:45.161474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:45.161919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:45.162714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:45.163142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:45.225537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:45.226139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:45.227158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:45.234384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:45.234950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:45.236136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:45.236754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:45.238771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:45.241081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:45.242587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-32f4a607-de7a-46cf-ba20-5f572f4c1751 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094789 Jun 29 10:22:45.243137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 913/1747] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:45.367119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:45.375494 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2ff180b-44bf-464e-8e4d-6b7532b50443 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.153963 Jun 29 10:22:45.376127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 835/1748] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:45.475885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:45.476494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:45.483440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:45.483867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:45.484657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:45.485090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:45.628403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:45.638706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-faddc989-9637-41fc-9be5-41dd2375ae15 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166790 Jun 29 10:22:45.639269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 914/1749] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:45 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:46.262734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:46.263366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:46.270294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:46.270863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:46.271639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:46.272068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:46.337278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:46.350532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:46.352800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:46.354204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b414bda9-4aea-4c80-b7c8-a92077743f62 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096285 Jun 29 10:22:46.354751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 836/1750] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:46.393644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:46.394207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:46.401303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:46.401755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:46.402521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:46.402996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:46.546967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:46.555318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dd78e859-977a-4c73-bc78-92f01cac9243 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165696 Jun 29 10:22:46.555882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 915/1751] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:46.659209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:46.659931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:46.668376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:46.669096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:46.670131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:46.670878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:46.834039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:46.842906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f37923dc-0d20-4b8f-8685-993f4422ba1a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.189738 Jun 29 10:22:46.843486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 837/1752] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:46 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:47.373348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:47.373753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:47.380681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:47.381164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:47.381918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:47.382415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:47.463762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:47.475780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:47.478134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:47.479697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4314e099-f13c-4743-8f3f-66823824cd53 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.110785 Jun 29 10:22:47.480238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 916/1753] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:47.580285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:47.580928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:47.590470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:47.590960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:47.591737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:47.592176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:47.731054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:47.739962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-44573f69-d5ef-4c62-803c-8ead426d3537 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165663 Jun 29 10:22:47.740505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 838/1754] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:47.863771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:47.864384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:47.870770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:47.871197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:47.872002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:47.872410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:48.015529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:48.024096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6ccf9bd2-634a-4740-bd5e-101a06beb6d0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164265 Jun 29 10:22:48.024669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 917/1755] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:47 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:48.499751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:48.500373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:48.506852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:48.507397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:48.508183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:48.508621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:48.577273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:48.586032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:48.587553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:48.588728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3d53ff5-adfe-4113-a5f5-2c5f6542469a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093318 Jun 29 10:22:48.589315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 839/1756] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:48.757923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:48.758550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:48.765556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:48.766016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:48.766937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:48.767373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:48.908236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:48.920719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4f213e36-39a0-4445-ad60-f5465ae5fe6d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.166513 Jun 29 10:22:48.921619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 918/1757] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:49.042194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:49.043128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:49.050863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:49.051344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:49.052124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:49.052561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:49.202409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:49.211053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e90c327-dc6b-49c9-8c7b-452bf8722461 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172889 Jun 29 10:22:49.211637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 840/1758] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:49 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:49.613501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:49.614104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:49.620553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:49.621007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:49.621937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:49.622259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:49.683709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:49.692770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:49.694260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:49.695442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94cab7f5-b68b-4e0d-b80b-d012c22c520a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.086060 Jun 29 10:22:49.696004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 919/1759] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:49.942804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:49.943424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:49.950027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:49.950478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:49.951273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:49.951708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:49.966859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:50.088657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:50.098688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7c83ebc-1331-459f-8d47-85beb27a6c6c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160108 Jun 29 10:22:50.099272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 841/1760] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:49 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:50.232316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:50.232935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:50.235185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:50.240936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:50.241419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:50.242198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:50.242743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:50.378210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:50.386550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6022eaec-d48a-4be3-a92e-ad6601f57e56 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160597 Jun 29 10:22:50.387141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 920/1761] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:50 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:50.723873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:50.724708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:50.734088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:50.734542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:50.735419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:50.735849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:50.815799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:50.829019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:50.830491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:50.831645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b30122b2-93f3-4f99-8283-1d0a9e0036f1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114212 Jun 29 10:22:50.832226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 842/1762] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:51.116649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:51.117291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:51.123774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:51.124223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:51.124989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:51.125425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:51.260785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:51.269828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b97956b1-ff58-4504-b36e-9d37e31f39aa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.156589 Jun 29 10:22:51.270723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 921/1763] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:51 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:51.404448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:51.405133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:51.412153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:51.412601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:51.413359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:51.413786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:51.558483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:51.567672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e36c0c2f-52ee-4eb5-a3ee-6c2b69d925f8 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167423 Jun 29 10:22:51.568245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 843/1764] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:51.854611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:51.855386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:51.864326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:51.864914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:51.865980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:51.866496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:51.933511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:51.943397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:51.944882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:51.946028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-57c5ccaf-709a-4513-b06e-8dea58feeeaf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099895 Jun 29 10:22:51.946604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 922/1765] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:52.290728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:52.291363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:52.298451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:52.298951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:52.299716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:52.300144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:52.451708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:52.460179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-37034f1a-5884-4a36-bc87-c1b9b98a6c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173476 Jun 29 10:22:52.460757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 844/1766] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:52.586332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:52.586926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:52.596171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:52.596675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:52.597458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:52.597881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:52.600537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:22:52.746278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:52.755657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-40f9bb2d-37d4-46a9-9444-ce5b061afc25 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173476 Jun 29 10:22:52.756233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 923/1767] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:52 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:52.967389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:52.968042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:52.977930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:52.978497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:52.979709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:52.980305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:53.047093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:53.056199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:53.057661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:53.058856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6abf6db7-24b0-4052-8d81-ba7dd42386b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097472 Jun 29 10:22:53.059440 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 845/1768] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:53.478693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:53.479293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:53.486879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:53.487331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:53.488087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:53.488503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:53.639354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:53.647532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-82f53bee-0f6a-43ce-9204-8506efe93b25 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.173054 Jun 29 10:22:53.648082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 924/1769] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:53.774162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:53.774816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:53.781798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:53.782246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:53.783055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:53.783489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:53.919923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:53.928437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-60d2b369-847c-4c63-8a74-68d17d1807cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158288 Jun 29 10:22:53.929021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 846/1770] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:54.077983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:54.078608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:54.085271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:54.085672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:54.086481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:54.086956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:54.165245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:54.174150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:54.175680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:54.176910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca65b0f9-eb36-4125-8b87-c4954114799e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103250 Jun 29 10:22:54.177419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 925/1771] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:54.666147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:54.666787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:54.673972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:54.674416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:54.675200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:54.675630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:54.820773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:54.833150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-94f240e5-4130-4f45-87a9-82458d5322c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170740 Jun 29 10:22:54.834056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 847/1772] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:54 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:54.947037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:54.947610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:54.955402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:54.955852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:54.956608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:54.957047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:55.102427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:55.112694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fbfe3f73-4c64-4e80-b26c-b111421a62d7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169854 Jun 29 10:22:55.113268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 926/1773] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:54 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:55.195792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:55.196408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:55.203660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:55.204037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:55.204836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:55.205271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:55.272979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:55.285418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:55.287827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:55.289434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-93145613-9df3-4a78-a23a-e4e266c66c0c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097755 Jun 29 10:22:55.290225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 848/1774] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:55.856656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:55.857583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:55.864717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:55.865168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:55.865899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:55.866376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:56.010239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:56.019223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aeeaebbe-a634-468e-8d2c-0071a3ae2f42 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168618 Jun 29 10:22:56.019817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 927/1775] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:55 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:56.129602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:56.130457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:56.137541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:56.137985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:56.138797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:56.139203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:56.284185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:56.297069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a43ad37-b56a-4ea6-8b75-682971b244db tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171203 Jun 29 10:22:56.297736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 849/1776] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:56.308210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:56.308823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:56.316917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:56.317442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:56.318220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:56.318695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:56.386663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:56.401114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:56.403464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:56.405222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-234b7020-d05d-4410-be52-d83b17d132fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101155 Jun 29 10:22:56.406160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 928/1777] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:57.039449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:57.040127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:57.047946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:57.047946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:57.049065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:57.049562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:57.195220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:57.203482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c41596a2-e32a-4eb2-8c2f-77397d71e69b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.169467 Jun 29 10:22:57.204231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 850/1778] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:57 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:57.315825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:57.316734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:57.323812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:57.324266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:57.325039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:57.325463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:57.425053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:57.425671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:57.432474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:57.432924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:57.433822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:57.434206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:57.460587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:57.469056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-588af1e9-e864-493d-9a99-a85200003925 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157736 Jun 29 10:22:57.469648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 929/1779] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:57 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:57.503493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:57.512477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:57.513963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:57.515166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c615412e-b5b6-468d-902d-550c4d21ffe0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094794 Jun 29 10:22:57.515750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 851/1780] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:58.224608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:58.225365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:58.233708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:58.234158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:58.235070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:58.235538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:58.366671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:58.375923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8157879f-4c23-4329-8947-472b0a7681bc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.156023 Jun 29 10:22:58.376536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 930/1781] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:58.489202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:58.489852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:58.499120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:58.499739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:58.500994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:58.501410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:58.538292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:58.539253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:58.545888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:58.546333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:58.547139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:58.547623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:58.618554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:58.627745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:58.629253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:58.630427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-528a1691-cb4d-4ea0-9946-53ceaba2c5bd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096209 Jun 29 10:22:58.631016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 931/1782] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:58.634239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:58.643214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-39159404-ed51-41ff-9294-f7631948ff17 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159836 Jun 29 10:22:58.643782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 852/1783] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:58 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:59.394359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:59.395763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:59.402863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:59.403316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:59.404089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:59.404517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:59.546924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:59.555407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-58d220ed-54be-4366-a4a0-4a20dc8da733 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165996 Jun 29 10:22:59.555957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 932/1784] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:22:59.648997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:59.649590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:59.656535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:59.657095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:59.657918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:59.658348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:59.665274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:22:59.665999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:22:59.672355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:59.673044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:59.674272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:22:59.674744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:22:59.721678 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:59.730988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:59.732848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:59.734004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-569c6e8c-0a55-446f-9cf0-f50bc81d17f2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089125 Jun 29 10:22:59.734574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 853/1785] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:22:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:22:59.809443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:22:59.818698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e53068db-74c6-4c57-9110-d33202c3765c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157245 Jun 29 10:22:59.819246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 933/1786] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:22:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:00.574045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:00.574687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:00.581738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:00.582205 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:00.582985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:00.583415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:00.732844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:00.750302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-02ed27f5-02df-459d-9bf9-8e3c7e88b79c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.179775 Jun 29 10:23:00.752174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 854/1787] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:00 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:00.755237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:00.755858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:00.762908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:00.763344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:00.764121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:00.764548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:00.835989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:00.836623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:00.837191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:00.842801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:00.843247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:00.844008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:00.844618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:00.846084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:00.847630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:00.848804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ccdada1b-c160-4454-ad2f-5d3489e24b9e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098651 Jun 29 10:23:00.849472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 934/1788] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:00.984885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:00.993857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-351a2fe2-5407-42fe-950b-7e12ac3f3701 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161799 Jun 29 10:23:00.994404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 855/1789] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:01.769254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:01.769842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:01.778124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:01.778599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:01.779433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:01.779866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:01.867825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:01.868428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:01.874724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:01.875170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:01.876162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:01.876712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:01.922668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:01.930967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-84db8577-6356-495c-8688-33ddcbdaed3c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.165682 Jun 29 10:23:01.940999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 935/1790] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:01 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:01.943537 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:01.952165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:01.953649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:01.955146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-da2b7d70-1855-4f6b-8d84-374390f99163 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091685 Jun 29 10:23:01.955799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 856/1791] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:23:02.011981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:02.012595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:02.019350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:02.019796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:02.020599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:02.021026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:02.159195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:02.169115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9e38ad88-510c-427d-a246-726aac1d48e1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161055 Jun 29 10:23:02.169739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 936/1792] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:02.951596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:02.952210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:02.968681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:02.969134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:02.969922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:02.970386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:02.974999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:02.975634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:02.982610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:02.983056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:02.983833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:02.984268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:03.054126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:03.063793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:03.066661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:03.067886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fad852a9-fb75-44f4-8949-f4bef1f14caf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097454 Jun 29 10:23:03.068482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 937/1793] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:03.135076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:03.143780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a3d82d2-d3fd-471e-9c24-dca35bae70b1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.198782 Jun 29 10:23:03.144448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 857/1794] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:02 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:03.189015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:03.189642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:03.197643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:03.198081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:03.199416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:03.199996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:03.351456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:03.367747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-61f63255-0c4f-40ee-a80f-c6372884724b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.183783 Jun 29 10:23:03.368106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 938/1795] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:03 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:04.088419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:04.089074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:04.099448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:04.099948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:04.101088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:04.101711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:04.105424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:04.161426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:04.162030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:04.171089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:04.171548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:04.172487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:04.173401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:04.175070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:04.184245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:04.185934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:04.187236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-926538a2-7741-409e-9642-ec42f8cf48da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.104862 Jun 29 10:23:04.187806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 858/1796] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:04.314548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:04.318009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:04.328459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8f5d3343-9261-4d49-8bb4-f9d28a2eebce tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170633 Jun 29 10:23:04.329241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 939/1797] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:04 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:04.385716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:04.386327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:04.392917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:04.393421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:04.394195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:04.394657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:04.531581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:04.540462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-09058346-387a-47da-8739-3dcca3f9fd35 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158656 Jun 29 10:23:04.541020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 859/1798] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:04 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:05.213115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:05.214108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:05.224545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:05.224999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:05.225778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:05.226210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:05.292931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:05.301894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:05.303412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:05.304578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f4e68c6b-e0a6-4f67-aa7b-ebcc16ef308f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099550 Jun 29 10:23:05.305140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 940/1799] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:05.345430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:05.345946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:05.353155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:05.353608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:05.354380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:05.354865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:05.498557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:05.509712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3be94a8-f020-4b7d-9ab0-df6ad0c8abbf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167768 Jun 29 10:23:05.510350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 860/1800] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:05.559884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:05.560674 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:05.568503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:05.568942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:05.569742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:05.570199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:05.704459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:05.713280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-99c8c635-8897-4fe8-8e5e-0fd014932838 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159138 Jun 29 10:23:05.713858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 941/1801] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:05 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:06.322853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:06.323362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:06.330168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:06.330626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:06.331455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:06.331945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:06.398790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:06.407515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:06.409022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:06.410768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3190d9ed-e1b1-46c9-a7dc-5ea9a3e23b1f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091699 Jun 29 10:23:06.411331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 861/1802] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:06.532579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:06.533229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:06.543433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:06.543877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:06.544646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:06.545078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:06.698788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:06.711046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-adcc086e-c645-433d-a950-5f510e128adb tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.185692 Jun 29 10:23:06.711853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 942/1803] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:06.735697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:06.736293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:06.743525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:06.744066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:06.744844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:06.745280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:06.894685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:06.907231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-690b7c04-620d-4f27-a0ce-4e98f5bcf1d6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.175050 Jun 29 10:23:06.907989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 862/1804] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:06 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:07.430062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:07.430696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:07.437297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:07.437778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:07.438548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:07.439010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:07.505835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:07.515113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:07.516679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:07.517802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-65690eec-a04d-4c57-90e7-43bd54eb8585 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092615 Jun 29 10:23:07.518356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 943/1805] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:07.732294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:07.732910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:07.740206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:07.740657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:07.741434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:07.741861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:07.894020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:07.902858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b94a58b1-0419-45f1-b4d8-c494f8f41954 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.174506 Jun 29 10:23:07.903432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 863/1806] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:07 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:07.927948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:07.928509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:07.936228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:07.936692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:07.937473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:07.937914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:08.094244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:08.106766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-18b4a46b-7a44-4245-9015-b519c869f638 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.182644 Jun 29 10:23:08.107602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 944/1807] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:07 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:08.536344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:08.536960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:08.543273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:08.543714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:08.544484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:08.544913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:08.614648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:08.623856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:08.625334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:08.626493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dfe8ea06-4d6d-42f9-af9f-1b9ba9a3d9ab tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094455 Jun 29 10:23:08.627092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 864/1808] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:08.925751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:08.926480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:08.933713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:08.934345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:08.934931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:08.935398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:09.078381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:09.088701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0800456b-fc9e-4366-b744-04892d448e70 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168798 Jun 29 10:23:09.089276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 945/1809] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:09.127295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:09.127867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:09.135224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:09.135620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:09.136397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:09.136833 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:09.275361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:09.283660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e8eebfa4-cd59-42ee-8879-405a8a00f7da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160328 Jun 29 10:23:09.284228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 865/1810] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:09.647630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:09.648379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:09.655023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:09.655472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:09.656233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:09.656664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:09.724878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:09.733740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:09.735284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:09.736447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa64ae9a-8167-40c6-b662-537a4805c5c3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094573 Jun 29 10:23:09.737027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 946/1811] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:10.107403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:10.108101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:10.111221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:10.115072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:10.115643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:10.116415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:10.116845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:10.262533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:10.271499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4d4f2621-2c9d-4131-ba02-11259b34b01e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168494 Jun 29 10:23:10.272063 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 866/1812] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:10 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:10.301278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:10.301893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:10.309025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:10.309422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:10.310188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:10.310658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:10.461936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:10.471132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fc52622a-45df-4ef5-98c4-fe29ab7168f5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173726 Jun 29 10:23:10.471682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 947/1813] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:10 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:10.755971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:10.756580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:10.763220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:10.763671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:10.764432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:10.764865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:10.827036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:10.835799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:10.837323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:10.838469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-72297963-3591-4bcf-be88-434c355ce8f8 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.086739 Jun 29 10:23:10.839065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 867/1814] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:11.293837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:11.294446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:11.300749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:11.301178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:11.301940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:11.302927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:11.442326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:11.451165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d52b0566-2046-4947-8979-c1b347fe5add tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161330 Jun 29 10:23:11.451731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 948/1815] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:11.492311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:11.492930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:11.499928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:11.500386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:11.501162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:11.501600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:11.665140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:11.673519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f18e9242-8b8c-43e7-b6d9-39a7f0c448bb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185339 Jun 29 10:23:11.674283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 868/1816] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:11 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:11.858490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:11.859188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:11.866844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:11.867293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:11.868084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:11.868509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:11.943726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:11.952351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:11.953831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:11.955299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8b11b09c-63ea-4d70-acc3-2669ed18ee63 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101729 Jun 29 10:23:11.955846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 949/1817] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:12.469017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:12.469634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:12.477086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:12.477525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:12.478294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:12.478772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:12.616419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:12.625050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50d8af9c-c5c5-4568-823d-5d542d7afc6a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159973 Jun 29 10:23:12.625612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 869/1818] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:12 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:12.695261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:12.695925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:12.706165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:12.706608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:12.707494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:12.707935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:12.851793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:12.860420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e77a0bc-a007-4661-8667-f0befa9a9422 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172018 Jun 29 10:23:12.860989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 950/1819] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:12 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:12.974751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:12.975775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:12.984668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:12.985138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:12.985936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:12.986446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:13.050465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:13.059742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:13.061244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:13.062409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7b986e90-bcb9-4997-82c2-32c773dee50a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091814 Jun 29 10:23:13.063001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 870/1820] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:13.645769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:13.646741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:13.653420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:13.653848 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:13.654645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:13.655083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:13.791092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:13.799199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5c18199b-39a4-4d3c-afec-ed6ae518038e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.159717 Jun 29 10:23:13.799773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 951/1821] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:13 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:13.878878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:13.879493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:13.886905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:13.887355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:13.888126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:13.888562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:14.054933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:14.063055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45d45b2c-ca31-400e-8a42-45f14e9cdec3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.188103 Jun 29 10:23:14.063627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 871/1822] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:13 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:14.081065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:14.081709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:14.088414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:14.088866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:14.089645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:14.090109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:14.166817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:14.176048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:14.177543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:14.179427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-09f0edb6-8b04-4bed-a009-6209f27ff268 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101693 Jun 29 10:23:14.179999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 952/1823] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:14.819232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:14.820695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:14.829147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:14.829703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:14.830719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:14.831299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:14.973838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:14.986227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-11188167-aa6d-4505-91b6-a99024e60dad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.172469 Jun 29 10:23:14.986958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 872/1824] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:14 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:15.081073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:15.081606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:15.088804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:15.089256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:15.090024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:15.090463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:15.202420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:15.203374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:15.209500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:15.209942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:15.211458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:15.211892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:15.223965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:15.232377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9389904-10cf-4cc8-9b80-fd59eb0fbd48 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.155357 Jun 29 10:23:15.233114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 953/1825] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:15 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:15.279003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:15.287616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:15.289766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:15.290946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3abaf7b5-e386-40c1-a119-d79ac822e4cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092817 Jun 29 10:23:15.291502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 873/1826] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:23:16.006316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:16.006995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:16.014160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:16.014667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:16.015530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:16.015966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:16.150381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:16.158712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ddfdb4b0-5ccd-4102-91e0-69ca573ee615 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.156610 Jun 29 10:23:16.159290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 954/1827] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:16.253677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:16.254744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:16.263255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:16.263637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:16.264408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:16.264944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:16.309066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:16.309687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:16.315889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:16.316695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:16.317477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:16.317909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:16.392562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:16.402248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:16.403783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:16.404942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-521cacbc-9c5f-4681-8659-62ae684f2f9f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099824 Jun 29 10:23:16.405790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 955/1828] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:23:16.423918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:16.426219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:16.434272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e4ec390-c0a7-4b27-b2c0-6425b5244996 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.187267 Jun 29 10:23:16.434898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 874/1829] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:16 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:17.177477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:17.178108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:17.185583 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:17.186036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:17.186852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:17.187284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:17.203733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:17.331825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:17.341636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ed8c8764-fc46-4e9b-827c-c25783e4e411 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.168698 Jun 29 10:23:17.342672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 956/1830] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:17.423527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:17.424140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:17.431887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:17.432331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:17.433090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:17.433515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:17.452646 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:17.453252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:17.459885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:17.460333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:17.461071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:17.461521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:17.502103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:17.511685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:17.513179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:17.514332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9bc22aa7-3aef-4dda-a762-73b60eacb74e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094820 Jun 29 10:23:17.514927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 875/1831] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:17.603033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:17.611132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a5d6f436-05ad-410d-9cd5-f830e5a1257d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162733 Jun 29 10:23:17.611697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 957/1832] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:17 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:18.363181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:18.363749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:18.371393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:18.371841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:18.372605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:18.373030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:18.515301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:18.526215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-439d9f51-7f1a-40a3-880f-145386c0f164 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167434 Jun 29 10:23:18.526825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 876/1833] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:18.533335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:18.534037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:18.541270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:18.541726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:18.542487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:18.542954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:18.609816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:18.621407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:18.622940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:18.624115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c9f75239-4a00-44af-b450-751772487512 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094725 Jun 29 10:23:18.624653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 958/1834] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:18.629386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:18.630013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:18.636993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:18.637452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:18.638222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:18.638766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:18.786330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:18.799603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f8e79c6-7fa5-40f4-a5be-f66fc45864fe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173819 Jun 29 10:23:18.800499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 877/1835] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:18 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:19.545223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:19.545869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:19.552856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:19.553306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:19.554069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:19.554507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:19.642230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:19.642995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:19.651209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:19.651721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:19.652486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:19.652914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:19.693481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:19.702253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1be54481-0071-4de6-92e7-9c6e330b40d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.161327 Jun 29 10:23:19.702867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 959/1836] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:19.716361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:19.725347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:19.726877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:19.728155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a4b03c8-cd8f-43df-b91d-8c83e126f13b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090007 Jun 29 10:23:19.728703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 878/1837] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:19.819446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:19.820227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:19.827351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:19.827822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:19.828558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:19.828991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:19.972619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:19.982000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dd307b42-20ad-4316-8fb1-c50b24129e59 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168138 Jun 29 10:23:19.982595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 960/1838] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:19 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:20.721433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:20.722244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:20.732079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:20.732674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:20.733733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:20.734303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:20.747058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:20.747862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:20.750249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=82 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:20.756214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:20.757187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:20.757439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:20.757903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:20.827921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:20.836902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:20.838714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:20.839890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a3173f8-c556-490b-b8d9-1350b151708c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097334 Jun 29 10:23:20.840450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 961/1839] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:23:20.892397 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:20.901324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0b73b4a-1f0c-4351-b9c4-539148eb9be4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.185271 Jun 29 10:23:20.901906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 879/1840] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:20 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:21.001962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:21.002486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:21.011404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:21.011993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:21.013052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:21.013642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:21.159169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:21.171269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bee9a047-0140-4928-86e2-602b005fcf7b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174895 Jun 29 10:23:21.171845 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 962/1841] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:20 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:21.859393 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:21.860043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:21.867300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:21.867754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:21.868513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:21.868947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:21.920096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:21.920882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:21.928788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:21.929189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:21.929962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:21.930402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:21.947153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:21.956246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:21.957719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:21.958893 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9ffcf28-26cb-4f35-82fe-be658f27a280 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103492 Jun 29 10:23:21.959474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 880/1842] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:22.067107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:22.075614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-21a067ae-61de-4622-b4dc-47da0729e9b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160029 Jun 29 10:23:22.076186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 963/1843] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:22.192079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:22.192870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:22.200631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:22.201084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:22.201822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:22.202276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:22.350893 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:22.364067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-476ab09e-8ac0-4a91-bedc-6f521213d17c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178097 Jun 29 10:23:22.364723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 881/1844] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:22 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:22.978167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:22.979355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:22.986793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:22.987236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:22.987996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:22.988423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:23.056098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:23.065385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:23.067279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:23.068426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7adae04-0b52-4206-91ab-a922a9f664fd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094489 Jun 29 10:23:23.068975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 964/1845] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:23.093283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:23.093883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:23.100857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:23.101298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:23.102052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:23.102479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:23.248851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:23.257287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3037c036-4a79-41a3-9e48-5bca34939877 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167879 Jun 29 10:23:23.257859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 882/1846] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:23:23.383753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:23.384365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:23.391732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:23.392187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:23.392935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:23.393366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:23.534405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:23.543311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-20aecd12-49ed-4f63-bea8-5c19be352607 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163678 Jun 29 10:23:23.543886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 965/1847] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:23 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:24.087322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:24.088185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:24.095042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:24.095691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:24.096171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:24.096607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:24.179155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:24.188337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:24.189827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:24.191403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-12331683-f602-4780-8c3d-aaff182d2de7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.107741 Jun 29 10:23:24.191959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 883/1848] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:24.274944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:24.275699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:24.282432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:24.282911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:24.283676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:24.284113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:24.417722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:24.426161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9361ede2-d4bd-4ae0-8b65-aa8f8428c1e9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.155235 Jun 29 10:23:24.426788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 966/1849] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:24.561414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:24.562020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:24.569024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:24.569471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:24.570208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:24.570668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:24.709738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:24.718191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5bda181-d407-42d7-9ddb-5e8b2cf1bd4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161374 Jun 29 10:23:24.718830 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 884/1850] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:24 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:25.209640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:25.210282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:25.218059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:25.218804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:25.219960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:25.220571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:25.299152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:25.308835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:25.310227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:25.311440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a298f7a-05fc-4278-a0d2-f96b1d2a4fc3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.105873 Jun 29 10:23:25.312022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 967/1851] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:25.446690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:25.447278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:25.454882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:25.455355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:25.456124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:25.456533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:25.597280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:25.607935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-297d72ff-32dd-4ac9-b6b9-8c91c598ff66 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.167014 Jun 29 10:23:25.608467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 885/1852] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:25 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:25.736062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:25.736672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:25.743595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:25.744049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:25.744859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:25.745274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:25.891620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:25.904021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e3acd5e-b196-4055-bd5e-5a5aa3d4a67b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171679 Jun 29 10:23:25.904747 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 968/1853] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:25 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:26.339344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:26.340045 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:26.349329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:26.349970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:26.351117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:26.351733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:26.415486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:26.424223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:26.425680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:26.426882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6f7dface-3851-4db8-a9de-b7edbaee56da tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093998 Jun 29 10:23:26.427437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 886/1854] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:26.630718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:26.631299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:26.639574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:26.640025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:26.640794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:26.641227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:26.777417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:26.789129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3900da95-e7d1-427a-954f-57e7da587b9c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.164113 Jun 29 10:23:26.789854 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 969/1855] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:26 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:26.927832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:26.928420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:26.936710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:26.937156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:26.937909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:26.938363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:27.082305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:27.094227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0c792645-7790-4d0d-8aa6-e969b1b6bf2d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172477 Jun 29 10:23:27.095046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 887/1856] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:26 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:27.446335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:27.447022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:27.454257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:27.454770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:27.455598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:27.456064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:27.525136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:27.534296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:27.535855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:27.537008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c307d54e-a06b-44b1-adcc-70e6f779d194 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095102 Jun 29 10:23:27.537575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 970/1857] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:27.808960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:27.809462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:27.815741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:27.816535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:27.817291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:27.817720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:27.952650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:27.965552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6ec8ca9-6cf3-42e2-b061-2cd29871943d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160843 Jun 29 10:23:27.966340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 888/1858] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:28.114897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:28.115510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:28.122124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:28.122592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:28.123418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:28.123843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:28.261541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:28.273338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f048029d-14ab-49f3-a28f-756bec4079df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162405 Jun 29 10:23:28.274201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 971/1859] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:28 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:28.557184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:28.557919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:28.567614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:28.568111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:28.569208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:28.569799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:28.645162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:28.654034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:28.655638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:28.656790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0a85eb8a-a3f9-4312-a245-738730db6182 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.105857 Jun 29 10:23:28.657343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 889/1860] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:28.989539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:28.990214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:28.997899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:28.998356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:28.999154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:28.999565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:29.140647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:29.148810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-03aa2a45-15f3-4feb-9b94-788fa5c287b4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163701 Jun 29 10:23:29.149412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 972/1861] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:29.294277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:29.294917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:29.301908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:29.302354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:29.303168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:29.303610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:29.441261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:29.450379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-003d6a75-7b10-446c-9c1c-fe05c9cda772 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161564 Jun 29 10:23:29.450988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 890/1862] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:29 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:29.675744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:29.676307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:29.692558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:29.693005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:29.693787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:29.694249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:29.697063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:29.767487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:29.779764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:29.781276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:29.782432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-51b99f10-a406-4abf-a2ca-70554f3a6aa7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.111010 Jun 29 10:23:29.783011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 973/1863] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:30.169658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:30.170270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:30.176904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:30.177347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:30.178119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:30.178536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:30.194516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:30.317989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:30.327179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-718a41f8-77c0-4427-8a12-5d6ee2b014a8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163178 Jun 29 10:23:30.327925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 891/1864] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:30.467879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:30.468500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:30.475470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:30.475922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:30.476690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:30.477126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:30.628130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:30.640342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e1dbaed6-2a5a-48a8-a0cd-58205816984d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.176429 Jun 29 10:23:30.641072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 974/1865] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:30 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:30.804157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:30.804859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:30.813837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:30.814454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:30.815592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:30.816473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:30.881463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:30.890502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:30.892035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:30.893189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f9af5d94-b6de-4d65-bad3-40c6f0d76ab6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095346 Jun 29 10:23:30.893751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 892/1866] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:31.347634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:31.348397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:31.357826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:31.358327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:31.359359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:31.359835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:31.493591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:31.502110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cba7b426-40a2-4baf-86e1-316adce50bef tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.160215 Jun 29 10:23:31.502683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 975/1867] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:31.661590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:31.662207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:31.669779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:31.670226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:31.671021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:31.671450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:31.817892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:31.826502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-03207073-fee1-410b-a4c4-1e3d068bda65 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168875 Jun 29 10:23:31.827134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 893/1868] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:31 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:31.918749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:31.919342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:31.926028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:31.926494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:31.927290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:31.927725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:31.995893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:32.005223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:32.006775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:32.007951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b8e3687e-afed-4233-8638-0eaceea37304 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095038 Jun 29 10:23:32.008497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 976/1869] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:32.520089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:32.520715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:32.527430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:32.527922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:32.528698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:32.529134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:32.678822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:32.697656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-143522fc-8b14-4a4f-b701-98dcfed11a8b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.181479 Jun 29 10:23:32.698230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 894/1870] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:32 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:32.845420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:32.846007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:32.852986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:32.853439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:32.854208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:32.854717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:32.993001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:33.001546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7e3ddfb-ce49-4f47-a9e0-93c14685c761 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160145 Jun 29 10:23:33.002121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 977/1871] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:32 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:33.029538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:33.030148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:33.036576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:33.037016 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:33.037772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:33.038202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:33.100438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:33.109614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:33.111147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:33.112301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-08377c2a-4d02-4179-8aae-e3962c324c2b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088323 Jun 29 10:23:33.112839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 895/1872] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:33.722870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:33.723703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:33.733071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:33.733743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:33.735040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:33.735640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:33.883711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:33.892537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-758177cb-5f5c-4a41-836a-39925a9a5a13 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.175867 Jun 29 10:23:33.893122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 978/1873] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:33 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:34.020006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:34.020598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:34.029493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:34.029939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:34.030866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:34.031301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:34.130045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:34.130772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:34.137444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:34.138367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:34.139246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:34.139757 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:34.177621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:34.186175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-68b8b83b-f2c4-4509-9f43-aa879bd59db9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170210 Jun 29 10:23:34.186807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 896/1874] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:34 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:34.207965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:34.216614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:34.218097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:34.219277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2f68e0aa-d16e-48c0-bb49-337b68a93c0d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093243 Jun 29 10:23:34.219827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 979/1875] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:34.910130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:34.910781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:34.917328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:34.917780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:34.918544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:34.919458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:35.057852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:35.069243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4cc542ab-769a-481f-8371-6b02d8f2be5c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.162809 Jun 29 10:23:35.070006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 897/1876] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:35.204091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:35.204681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:35.211636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:35.212085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:35.212852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:35.213285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:35.237553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:35.238161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:35.244470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:35.244916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:35.245674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:35.246111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:35.309154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:35.318553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:35.320256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:35.321421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-575a372e-aed4-48b6-b9d2-215292e862fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087906 Jun 29 10:23:35.321986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 898/1877] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:35.345633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:35.357488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7eee98df-011d-4e81-a840-09963bd8f1e9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156829 Jun 29 10:23:35.358037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 980/1878] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:35 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:36.088594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:36.089202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:36.096418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:36.096867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:36.097634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:36.098050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:36.240098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:36.248416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df68ecc4-ee79-46e5-9c70-b66b47f0fa27 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.163844 Jun 29 10:23:36.248960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 899/1879] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:36 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:36.341914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:36.342665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:36.352375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:36.352970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:36.354126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:36.354862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:36.375359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:36.376066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:36.382246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:36.382726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:36.383538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:36.383955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:36.418530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:36.428194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:36.429738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:36.430993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c0ab7649-79e9-4ad3-96af-840d004f5d6d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095173 Jun 29 10:23:36.431548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 981/1880] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:36.522422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:36.531093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb9d744c-6ea9-4245-804a-f3b0a13dce42 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159837 Jun 29 10:23:36.531672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 900/1881] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:36 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:37.266350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:37.266993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:37.274328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:37.274890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:37.275744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:37.276216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:37.427087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:37.436909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d8d785d4-61f5-4109-960a-f6933e35fb63 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.174939 Jun 29 10:23:37.437443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 982/1882] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:37.449461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:37.450121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:37.456896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:37.457360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:37.458116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:37.458549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:37.525783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:37.537407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:37.539598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:37.541241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-80107fae-b6a3-45d0-b04e-460c218661a1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095569 Jun 29 10:23:37.541989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 901/1883] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:37.549489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:37.550098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:37.556634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:37.557080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:37.557869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:37.558268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:37.702013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:37.710202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-37cb712d-0bb3-4db7-9675-7e5fff51ba36 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164660 Jun 29 10:23:37.710799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 983/1884] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:37 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:37.829160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:23:37.829446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:23:38.459136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:38.459940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:38.469841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:38.470479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:38.471703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:38.472313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:38.561149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:38.561756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:38.569212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:38.569683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:38.570450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:38.570907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:38.613707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:38.624026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5042c2c4-ed3d-4cb0-9458-2c5530ff4768 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.170813 Jun 29 10:23:38.624786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 902/1885] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:38 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:38.640939 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:38.649357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:38.650867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:38.652013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-20c016d2-b01b-4348-8aba-7914ae4d4b4c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095206 Jun 29 10:23:38.652572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 984/1886] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:38.971656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:38.972356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:38.978470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:38.978948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:38.979723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:38.980168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:39.123891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:39.135530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-237467c4-ec61-41a6-ae08-771a091d3d04 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.411119 Jun 29 10:23:39.136356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 903/1887] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:38 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:39.644097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:39.644720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:39.651450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:39.651911 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:39.652679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:39.653101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:39.670747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:39.671341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:39.678263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:39.678744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:39.679666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:39.680525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:39.745207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:39.754746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:39.756224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:39.757396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-def164f5-e95f-4738-b051-e99ab902b207 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090673 Jun 29 10:23:39.758154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 904/1888] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:39.824842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:39.833261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5ce664db-a31b-474a-bc45-114d56e3bc15 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1598 microversion: 2.1 time: 0.193027 Jun 29 10:23:39.839252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 985/1889] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:40.154662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:40.155319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:40.157946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:40.163661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.164105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.164880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.165300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.306160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-67aad43b-b4a0-4196-8b20-24192f9ab679 req-55878eb9-6414-4227-b6ba-24b17ae51a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab146cd-3f99-4717-94ea-5dd164c1f887", "name": "network-vif-deleted", "tag": "87511825-cede-4e5d-a0f9-cad98a2b6e4d"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:23:40.309459 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:40.310344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:23:40.310746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Jun 29 10:23:40.320210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-67aad43b-b4a0-4196-8b20-24192f9ab679 req-55878eb9-6414-4227-b6ba-24b17ae51a42 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.321386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-67aad43b-b4a0-4196-8b20-24192f9ab679 req-55878eb9-6414-4227-b6ba-24b17ae51a42 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.325594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4268cdd0-d5b8-4e76-9c3c-b8a0975d9106 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174842 Jun 29 10:23:40.326181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 905/1890] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:23:40.335441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-67aad43b-b4a0-4196-8b20-24192f9ab679 req-55878eb9-6414-4227-b6ba-24b17ae51a42 service nova] Creating event network-vif-deleted:87511825-cede-4e5d-a0f9-cad98a2b6e4d for instance 1ab146cd-3f99-4717-94ea-5dd164c1f887 on hv-cinder-76810 Jun 29 10:23:40.340659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-67aad43b-b4a0-4196-8b20-24192f9ab679 req-55878eb9-6414-4227-b6ba-24b17ae51a42 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038938 Jun 29 10:23:40.341282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 986/1891] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:23:40.775566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:40.776154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:40.783478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.783934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.784706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.785145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.850927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:40.851912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:40.852612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:40.859190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.859634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.860148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:40.860393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:40.860811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:40.861677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:40.862865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-162ba73f-4357-4953-9b32-f07c86d8c57b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091655 Jun 29 10:23:40.863484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 906/1892] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:40.932881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:40.941802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fd6b587b-508e-4e58-bf3f-e7bbaa9896c9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.094561 Jun 29 10:23:40.942393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 987/1893] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:41.345724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:41.346342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:41.352967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:41.353483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:41.354256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:41.354726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:41.504539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:41.517071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ff78293-fb42-4e0e-86d5-e4afd16b56bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.175534 Jun 29 10:23:41.517641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 907/1894] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:41 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:41.881987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:41.882597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:41.889847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:41.890306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:41.891187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:41.891619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:41.962610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:41.962854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:41.963486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:41.971067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:41.971668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:41.972491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:41.972688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:41.973163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:41.973951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:41.975159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e8592dc6-f5f7-4b4b-abc8-a1b2f424505d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097231 Jun 29 10:23:41.975693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 988/1895] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:41.977004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:42.041074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:42.051055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1844918c-c03d-48d6-8e43-7ab982e521bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.092141 Jun 29 10:23:42.051654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 908/1896] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:41 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:23:42.534981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:42.535597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:42.542196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:42.545039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:42.545039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:42.545039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:42.678932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:42.689440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d2d0079d-d505-41ab-aca3-16853e54d626 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158619 Jun 29 10:23:42.690077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 989/1897] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:42 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:42.995948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:42.996529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:43.004523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:43.005015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:43.005838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:43.006305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:43.069176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:43.069784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:43.075209 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:43.076840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:43.077389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:43.078245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:43.078722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:43.084617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:43.086105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:43.087287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4eeb17e-5219-439f-9a19-fabb9c0ae54b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095987 Jun 29 10:23:43.087814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 909/1898] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:23:43.094468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:43.141283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:43.149567 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7d260d9b-388e-4b1c-98f1-e388cc90b034 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.084760 Jun 29 10:23:43.150124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 990/1899] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:43 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:43.708572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:43.709187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:43.715686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:43.716135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:43.716920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:43.717357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:43.872158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:43.880964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64f60483-10b9-43df-8f7e-225c9719a946 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.176881 Jun 29 10:23:43.881569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 910/1900] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:43 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:44.105881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:44.106488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:44.113256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:44.113689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:44.114479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:44.114940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:44.167412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:44.168013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:44.175007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:44.175457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:44.176231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:44.176667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:44.183983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:44.193522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:44.195039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:44.196229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-64e2aba2-4c6b-4e24-8c10-b564794da104 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094387 Jun 29 10:23:44.196805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 991/1901] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:44.241584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:44.249767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66b93ca5-cec6-4068-a8b1-e9815385c551 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086347 Jun 29 10:23:44.250337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 911/1902] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:44 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:23:44.898137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:44.898779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:44.905435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:44.905888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:44.906705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:44.907147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:45.044062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:45.053742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-176dcc6e-5274-4b39-a157-1d2f5bea83bf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159554 Jun 29 10:23:45.054365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 992/1903] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:44 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:45.215664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:45.216290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:45.223676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:45.224121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:45.224876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:45.225311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:45.268973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:45.269741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:45.277246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:45.277697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:45.278481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:45.279237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:45.299605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:45.310225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:45.311741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:45.312881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ba629aa3-6e39-43a9-8c61-8dbb45131b6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101293 Jun 29 10:23:45.313435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 912/1904] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:45.344372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:45.353239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7b0abc17-b28a-4f43-84d0-4f2b4859eabe tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089749 Jun 29 10:23:45.353783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 993/1905] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:46.071744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:46.072378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:46.079023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:46.079562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:46.081038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:46.081470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:46.219313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:46.229359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bc67d6d7-bd29-42e1-8c7d-1d758da8faa0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161029 Jun 29 10:23:46.229961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 913/1906] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:46 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:46.331510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:46.332143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:46.339017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:46.339462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:46.340229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:46.340660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:46.371718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:46.372711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:46.380737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:46.381182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:46.381992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:46.382469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:46.416341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:46.425780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:46.427760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:46.428687 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c0def2ac-83a0-491d-bd7e-668fc8f63b1b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101452 Jun 29 10:23:46.429722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 994/1907] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:46.447721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:46.458620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4f8b930-1f3e-438e-aae0-e255f90ee72d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.091245 Jun 29 10:23:46.459228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 914/1908] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:47.246471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:47.247131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:47.254691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:47.255137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:47.255912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:47.256330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:47.411340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:47.421917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-300c2070-ae5a-40c4-b8d3-d20b202b2545 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179098 Jun 29 10:23:47.422720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 995/1909] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:47 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:47.447089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:47.447646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:47.454792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:47.455252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:47.456024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:47.456463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:47.476003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:47.476612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:47.483077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:47.483520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:47.484345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:47.484778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:47.524577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:47.533662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:47.535354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:47.536531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2fe618d6-7fa0-478f-9be6-2ef16479f18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093414 Jun 29 10:23:47.537313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 915/1910] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:47 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:47.547745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:47.556683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f9442f94-1602-4c36-9d3c-e0577319667e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.084795 Jun 29 10:23:47.557228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 996/1911] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:48.439660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:48.440946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:48.447615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:48.448221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:48.448801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:48.449233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:48.555182 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:48.555778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:48.562496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:48.562983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:48.563781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:48.564204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:48.584257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:48.592599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-05f78a0d-e8fe-4438-8d8d-2a28d3802b6d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157084 Jun 29 10:23:48.593171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 916/1912] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:48 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:48.597861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:48.602192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:48.609185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:48.609821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:48.610592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:48.611056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:48.639095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:48.648401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:48.649901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:48.651127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9196f682-99a1-40ee-9eee-d0a644fb85fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100335 Jun 29 10:23:48.651683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 997/1913] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:23:48.680132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:48.688444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2bf1580f-d880-44fa-9187-a7f1fcfc5f22 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.094152 Jun 29 10:23:48.689015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 917/1914] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:49.612283 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:49.613508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:49.623345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:49.624000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:49.624856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:49.625471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:49.669530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:49.670193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:49.677447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:49.677911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:49.678688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:49.679116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:49.748963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:49.756026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:49.758338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:49.759528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2c75e52c-9881-4a63-99e5-4386e8336d73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093995 Jun 29 10:23:49.760330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 918/1915] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:49.764234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:49.768428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:49.769316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:49.775692 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3f780a05-dfa8-4c6e-9786-09707d08bb9d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168696 Jun 29 10:23:49.775951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:49.776394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:49.777249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 998/1916] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:49 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:49.777483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:49.777645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:49.845562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:49.857557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4048717-f50d-4111-9a01-2b6cd7d0d5c1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093078 Jun 29 10:23:49.858336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 919/1917] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:49 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:50.778940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:50.779647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:50.782068 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=76 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:50.789015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:50.789454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:50.790295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:50.790763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:50.797098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:50.797780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:50.804880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:50.805329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:50.806141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:50.806550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:50.875187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:50.885920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:50.887827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:50.889001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c3f8ca7-e1c3-4e3f-95a0-e1d58500e568 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114121 Jun 29 10:23:50.889570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 999/1918] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:50.895233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:50.896036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:50.906371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:50.906850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:50.907620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:50.908053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:50.945257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:50.953705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-893afd0a-42a9-43ea-9246-092084b5f6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160424 Jun 29 10:23:50.954423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 920/1919] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:50 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:50.981913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:50.990193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-22e57f69-25f6-4452-96bb-b1b5861d93f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.099342 Jun 29 10:23:50.990805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1000/1920] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:51.908108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:51.908764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:51.915887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:51.916338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:51.917108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:51.917547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:51.971329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:51.972030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:51.979285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:51.979407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:51.980348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:51.980633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:51.981337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:51.992064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:51.993528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:51.994712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ee9e26ee-7f0f-4c94-a0ce-3394ad8ec18f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091130 Jun 29 10:23:51.995275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 921/1921] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:52.007126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:52.007771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:52.014010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:52.014455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:52.015292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:52.015739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:52.081806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:52.090864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e22142df-6426-4c12-9b00-1aa7bb3689f8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087437 Jun 29 10:23:52.091442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 922/1922] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:52.119038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:52.127160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9832a8c8-0825-4a47-b08f-efa33548bf6a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159896 Jun 29 10:23:52.127727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1001/1923] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:23:53.012929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:53.013646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:53.021048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:53.021496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:53.022247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:53.022981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:53.086764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:53.095723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:53.097207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:53.099090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f16c7878-7138-4a1f-8a28-b2d67bffe1d6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089478 Jun 29 10:23:53.099653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 923/1924] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:53.108299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:53.109247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:53.116431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:53.116885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:53.117641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:53.118071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:53.145311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:53.145914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:53.154391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:53.154882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:53.155661 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:53.156094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:53.184298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:53.193600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4a46735e-056d-4150-873b-02bf79fb33c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089470 Jun 29 10:23:53.194206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1002/1925] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:53.289237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:53.291497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:53.298438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9b0ddd7-d189-4f7d-a22b-7c2c62407e33 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157156 Jun 29 10:23:53.299034 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 924/1926] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:54.118013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:54.118644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:54.124978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:54.125406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:54.126160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:54.126657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:54.196045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:54.204915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:54.206353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:54.208294 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5af20a5e-1a92-4f6d-98cd-d0a9cddbae84 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093902 Jun 29 10:23:54.208879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1003/1927] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:54.211093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:54.211744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:54.218975 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:54.219410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:54.220175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:54.220655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:54.285204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:54.294363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ba3ec41-7c1c-4a89-873f-cb5be284461d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087360 Jun 29 10:23:54.294958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 925/1928] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:54 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:54.316463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:54.317424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:54.324200 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:54.324669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:54.325439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:54.325904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:54.460337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:54.468510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6f9e2b97-478e-4ce1-9c4c-3c54677f5c95 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156348 Jun 29 10:23:54.469080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1004/1929] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:54 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:55.231074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:55.231740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:55.238759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:55.239221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:55.240005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:55.240407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:55.307525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:55.312372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:55.312985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:55.317618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:55.319238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:55.320422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-263538d0-3906-4895-be08-aa6c83639299 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098115 Jun 29 10:23:55.320981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 926/1930] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:55.321115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:55.321424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:55.322223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:55.322713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:55.384790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:55.392961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c6cec9b7-b796-4af4-b9bd-1ae5a644abca tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085073 Jun 29 10:23:55.393524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1005/1931] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:55 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:55.486027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:55.486667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:55.494382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:55.495133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:55.496445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:55.497188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:55.637626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:55.646343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c7a0e2c8-48ed-4583-a126-945550260550 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164249 Jun 29 10:23:55.646936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 927/1932] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:55 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:56.338797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:56.339386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:56.346485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:56.346965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:56.347742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:56.348271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:56.409536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:56.410196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:56.416957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:56.417754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:56.418215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:56.419223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:56.419665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:56.425793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:56.427591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:56.428799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-74f44e33-5dc0-4edd-8930-82fcac6ea63a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094190 Jun 29 10:23:56.429364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1006/1933] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:56.483580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:56.492478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1c11e9f1-b127-4caa-9e02-bf9cef30ab73 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086885 Jun 29 10:23:56.493054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 928/1934] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:56 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:56.668915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:56.669781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:56.679702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:56.680402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:56.681670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:56.682366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:56.686501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:23:56.837074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:56.845353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4a982a10-d392-4f54-8c5c-2ae149eb88ab tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.183628 Jun 29 10:23:56.845898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1007/1935] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:57.447569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:57.448180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:57.455460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:57.455908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:57.456668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:57.457095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:57.510415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:57.511067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:57.519581 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:57.520258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:57.521307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:57.521514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:57.524141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:57.535900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:57.538041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:57.539810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f41b0ab-5e03-4e1c-ab18-1e7843517dd3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095970 Jun 29 10:23:57.540378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 929/1936] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:57.590896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:57.601694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b161c73f-714c-4380-a41b-2ec5c4d77d47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095250 Jun 29 10:23:57.602265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1008/1937] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:57 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:57.863291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:57.864502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:57.871207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:57.871656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:57.872429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:57.872873 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:58.020997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:58.029392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e36cf067-420b-4903-bc0d-4d6a6a964a43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170064 Jun 29 10:23:58.029971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 930/1938] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:57 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:58.560811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:58.561478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:58.570276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:58.570762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:58.571534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:58.571961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:58.620365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:58.621232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:58.627633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:58.628081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:58.628818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:58.629347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:58.638749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:58.648448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:58.650625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:58.651119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b21476d8-347e-4354-aa05-c11f6b753db0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096373 Jun 29 10:23:58.651681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1009/1939] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:58 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:58.692069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:58.702738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6b9094f6-cb6c-430d-a364-186f801cc9e7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087569 Jun 29 10:23:58.703337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 931/1940] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:59.047199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:59.047816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:59.055102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:59.055732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:59.056577 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:59.056999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:59.200638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:59.209219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-67cb6134-32f2-4812-89b1-bea7bc71d9f6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165884 Jun 29 10:23:59.209819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1010/1941] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:23:59.670450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:59.671077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:59.679047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:59.679495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:59.680269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:59.680686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:59.723733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:23:59.724561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:23:59.731976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:59.732320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:59.733112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:23:59.733545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:23:59.746530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:59.755811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:59.757338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:59.758534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-415aa284-cce5-4627-bf5b-9be88e37dae1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092187 Jun 29 10:23:59.759133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 932/1942] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:23:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:23:59.797554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:23:59.805954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-80fa095d-2885-4e55-b23c-2bef3636a8be tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086135 Jun 29 10:23:59.806530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1011/1943] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:23:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:00.226877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:00.227518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:00.234367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:00.234851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:00.235636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:00.236070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:00.373222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:00.382453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc44122a-2d4e-420e-a9a8-3085869d9405 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159456 Jun 29 10:24:00.383079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 933/1944] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:00.776867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:00.777497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:00.785021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:00.785516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:00.786315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:00.786799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:00.824049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:00.824690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:00.835987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:00.837062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:00.839716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:00.840356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:00.866291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:00.874958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:00.876451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:00.877606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94702d83-ed46-4161-a019-3908819b4fdd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.104822 Jun 29 10:24:00.878175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1012/1945] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:00.907094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:00.915674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a72457eb-ecf6-4f85-870b-cc54b96be4f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095710 Jun 29 10:24:00.916258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 934/1946] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:00 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:01.402691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:01.403220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:01.409840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:01.410302 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:01.411443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:01.411882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:01.550444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:01.559156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-375eb5d7-df36-4931-96ca-ba04f7bf33ea tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.162437 Jun 29 10:24:01.559748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1013/1947] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:01 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:01.896887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:01.897541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:01.905180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:01.905611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:01.906450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:01.906971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:01.933227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:01.933872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:01.941083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:01.941527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:01.942605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:01.943256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:01.978881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:01.988047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:01.989616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:01.990818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3c841e2a-8a27-4114-83ef-df6649ba1858 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098169 Jun 29 10:24:01.991425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 935/1948] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:02.010412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:02.019597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-11f70933-bc32-4fd3-9d42-1d3c3b510356 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090405 Jun 29 10:24:02.020802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1014/1949] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:01 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:02.577514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:02.578156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:02.585721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:02.586167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:02.587240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:02.587669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:02.727144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:02.736615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-68b4c3b2-f6fc-4931-9f68-1f1ac018589a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163070 Jun 29 10:24:02.737199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 936/1950] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:03.009385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:03.010002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:03.017131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:03.017588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:03.018359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:03.018841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:03.036797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:03.037376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:03.044009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:03.044483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:03.045256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:03.045689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:03.082637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:03.091826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:03.093328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:03.094498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a1c943d-8279-4b05-8163-3fbeab869001 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089162 Jun 29 10:24:03.095098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1015/1951] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:03.109504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:03.121486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e638c582-1103-4f9e-b0a2-80c379906d38 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.088772 Jun 29 10:24:03.122276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 937/1952] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:03 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:03.753960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:03.754718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:03.761186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:03.761640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:03.762406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:03.763554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:03.904887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:03.916178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4e047d52-2182-445a-bacb-4357a2717e61 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165987 Jun 29 10:24:03.916796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1016/1953] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:03 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:04.113167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:04.114590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:04.122318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:04.122805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:04.123592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:04.124012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:04.144298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:04.146111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:04.154321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:04.154823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:04.155588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:04.156036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:04.193659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:04.204111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:04.206394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:04.207456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a871f5c2-5b01-41e1-acb4-c9ce4fdfdac5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098334 Jun 29 10:24:04.210006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 938/1954] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:04.227459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:04.239369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91fd3792-dc65-40aa-ade3-0a4f5583f744 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.101883 Jun 29 10:24:04.239987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1017/1955] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:04 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:04.933977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:04.934595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:04.941313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:04.941926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:04.942810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:04.943346 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:05.078954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:05.087575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fbb41a27-e9fd-4548-aaa0-05cf2b9045ca tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.157568 Jun 29 10:24:05.088159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 939/1956] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:04 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:05.230861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:05.231482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:05.238502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:05.239212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:05.239683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:05.240113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:05.260555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:05.261405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:05.268002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:05.268467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:05.269232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:05.269663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:05.310741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:05.320390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:05.322090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:05.323432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b9a884a1-47ea-489f-92ff-27bde9787514 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096573 Jun 29 10:24:05.323976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1018/1957] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:05.333800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:05.342418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-594aa5cb-1eb0-4f3d-bc87-24329fc5338f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085720 Jun 29 10:24:05.343041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 940/1958] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:06.105385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:06.105984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:06.112758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:06.113251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:06.114417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:06.114895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:06.253080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:06.265070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-459c7c52-cc05-456d-a888-475f28e52dd1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163420 Jun 29 10:24:06.265944 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1019/1959] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:06 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:06.342973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:06.343533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:06.350774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:06.351231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:06.351986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:06.352413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:06.360605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:06.361209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:06.368044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:06.368488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:06.369306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:06.369552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:06.369735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:06.419028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:06.428077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:06.429600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:06.431175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c137ea1c-be4f-459e-9fb3-5b01e67153fb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092711 Jun 29 10:24:06.431821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 941/1960] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:06.437035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:06.449963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9d656cc4-b50d-4f51-99a2-cca2e95c21e8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093451 Jun 29 10:24:06.450594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1020/1961] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:07.284327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:07.285048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:07.291538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:07.292020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:07.292791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:07.293226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:07.441747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:07.449859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:07.450812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:07.452041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aafd9d96-fa2f-49e3-b4c2-5c610f282160 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171588 Jun 29 10:24:07.452602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 942/1962] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:07 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:07.457580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:07.458100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:07.459478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:07.459478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:07.471895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:07.472530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:07.479438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:07.479905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:07.480669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:07.481086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:07.527430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:07.536597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:07.538620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:07.539802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0a06423a-8743-4142-9edb-fb3e35f3dd40 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093849 Jun 29 10:24:07.540396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1021/1963] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:07 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:24:07.549809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:07.559944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-67488dff-07be-4b39-994e-f63aa6913881 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.091789 Jun 29 10:24:07.560609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 943/1964] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:07 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:24:08.468875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:08.469509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:08.477268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:08.477715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:08.478457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:08.479014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:08.558379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:08.558949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:08.568094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:08.568505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:08.569280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:08.569708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:08.616741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:08.625876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4be681cc-20da-44ed-a897-0a65331afdcf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160832 Jun 29 10:24:08.626720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1022/1965] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:08 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:08.631384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:08.632170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:08.635926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:08.638880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:08.639338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:08.640110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:08.640543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:08.644850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:08.646601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:08.647782 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-219c9f24-766a-46fc-8c8e-f8c5938e3bb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093572 Jun 29 10:24:08.648556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 944/1966] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:08.703699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:08.706000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:08.713477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8395e55a-86bd-41e3-b352-0d5cc1ca5b1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085969 Jun 29 10:24:08.714050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1023/1967] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:09.644911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:09.645604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:09.653511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:09.653953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:09.654745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:09.655175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:09.666604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:09.667160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:09.673919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:09.674377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:09.675175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:09.675608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:09.743879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:09.752903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:09.754442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:09.755753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-52bbf308-9a95-4fce-b6b5-ccd453dc3c52 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093969 Jun 29 10:24:09.756328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1024/1968] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:09.760840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:09.761450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:09.767568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:09.768020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:09.768796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:09.769237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:09.792436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:09.800989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-937ed75f-34ed-4229-a06f-34e578546c9e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159986 Jun 29 10:24:09.801573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 945/1969] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:09.832122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:09.844028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-baf2c8cc-ad09-42ed-b791-ff91c1c76b29 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086521 Jun 29 10:24:09.844778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1025/1970] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:09 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:10.777545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:10.778165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:10.780527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=82 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:10.786096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:10.786583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:10.787338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:10.787773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:10.820108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:10.820713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:10.827846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:10.828317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:10.829128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:10.829573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:10.854660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:10.865288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:10.866837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:10.868033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-332325d8-2111-422e-b7f7-55aa8884034a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094491 Jun 29 10:24:10.868593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 946/1971] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:10.872967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:10.873578 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:10.879909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:10.880360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:10.881177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:10.881605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:10.945073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:10.953441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b1c3898b-a734-43b4-bee3-817893344856 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.083838 Jun 29 10:24:10.954011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 947/1972] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:10 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:10.962592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:10.970736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e4e6fd64-365b-4ca3-967b-f1ff2be62fc2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.154637 Jun 29 10:24:10.971314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1026/1973] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:10 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:11.887120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:11.887731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:11.894735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:11.895185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:11.895984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:11.896398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:11.969704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:11.972337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:11.973435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:11.979549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:11.982871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:11.983013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:11.983134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:11.983134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:11.983318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cce3f323-4abe-49f8-b577-2551276ec534 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098889 Jun 29 10:24:11.983419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:11.983507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 948/1974] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:11.989521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:11.990135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:11.996713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:11.997151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:11.997940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:11.998371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:12.056524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:12.065137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-77a74295-993a-4e5f-97a1-5876eeb7c5ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.097641 Jun 29 10:24:12.066078 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1027/1975] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:12.147929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:12.156328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cbf124b4-fd16-475a-8b06-010e800a6680 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170559 Jun 29 10:24:12.156861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 949/1976] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:11 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:24:13.005761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:13.006402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:13.014037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:13.014867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:13.015980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:13.016413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:13.083885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:13.084720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:13.092759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:13.093218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:13.095159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:13.095159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:13.095396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:13.104801 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:13.107907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:13.107907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a7b4e088-1538-4ccc-9b00-71913b49e1c1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.105934 Jun 29 10:24:13.108558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1028/1977] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:13.170315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:13.176418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:13.176659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:13.179489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f9693919-c3a0-41f9-9f1d-a1fd1f0abe60 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.099407 Jun 29 10:24:13.181061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 950/1978] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:13 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:13.183957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:13.184428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:13.185205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:13.185642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:13.564034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:13.577192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7bc95173-29fc-4dfc-a7ae-9a43c311ca07 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.406871 Jun 29 10:24:13.577893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1029/1979] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:13 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:14.128396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:14.129029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:14.137128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:14.137567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:14.138355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:14.138834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:14.199175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:14.199788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:14.207167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:14.207622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:14.207946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:14.208380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:14.208813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:14.217035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:14.218545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:14.219759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-501c16b6-f80b-464b-bfae-6fa4a5ce12e1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096839 Jun 29 10:24:14.220318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 951/1980] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:14.271269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:14.279496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-34ffeab1-0443-4438-a919-37f6e9a71dcf tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085596 Jun 29 10:24:14.280095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1030/1981] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:14 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:14.601730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:14.602636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:14.610969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:14.611432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:14.612371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:14.613002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:14.748980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:14.757290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66727e5c-1f90-4fca-84b4-b3eaab288972 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161681 Jun 29 10:24:14.757866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 952/1982] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:14 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:15.241624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:15.242358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:15.248678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:15.249123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:15.249887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:15.250329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:15.296845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:15.297549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:15.304668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:15.305118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:15.305913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:15.306343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:15.317490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:15.327041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:15.328553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:15.329707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1075c0ad-26ab-416e-b37c-9bbdb2282d74 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094273 Jun 29 10:24:15.330332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1031/1983] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:15.368590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:15.377242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89968984-2584-4ec1-9d1d-90b19ea922d4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.084258 Jun 29 10:24:15.377820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 953/1984] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:15 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:15.775421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:15.776042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:15.782585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:15.783046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:15.783827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:15.784262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:15.943045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:15.955436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cd80cc9c-0681-4923-a49a-329cd6c0f05b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.183677 Jun 29 10:24:15.956018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1032/1985] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:15 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:16.349011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:16.349600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:16.356809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:16.357258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:16.358020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:16.358452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:16.395221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:16.395847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:16.403274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:16.403782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:16.404703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:16.405127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:16.427149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:16.436922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:16.438483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:16.439665 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0c1bb0fa-f883-435a-ad0c-9b3c4f48f8ed tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094852 Jun 29 10:24:16.441286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 954/1986] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:16.478049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:16.487025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ea31378e-f888-4ff4-998a-403a81b6f4ab tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095585 Jun 29 10:24:16.487579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1033/1987] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:16.975039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:16.976219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:16.983044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:16.983527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:16.984371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:16.984838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:17.123318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:17.132104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-597bd79e-ceb7-4d82-bbd0-cf7e654338df tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161298 Jun 29 10:24:17.132654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 955/1988] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:16 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:17.459657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:17.460284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:17.467808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:17.468256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:17.469017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:17.469444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:17.504396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:17.505115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:17.512909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:17.513366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:17.514174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:17.514617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:17.535975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:17.545160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:17.546843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:17.548005 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef53021c-f259-47a9-b2cf-3e532bf7cdf6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092408 Jun 29 10:24:17.548566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1034/1989] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:17 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:17.581654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:17.591962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50f45236-4781-4545-8c8e-8003c05d50e1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.091599 Jun 29 10:24:17.592553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 956/1990] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:18.150845 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:18.151460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:18.158095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:18.158545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:18.159422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:18.159836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:18.302168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:18.310381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63864906-3609-4f77-8a2a-ba7ce9a4ae68 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164040 Jun 29 10:24:18.310907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1035/1991] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:18 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:18.568297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:18.568862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:18.576354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:18.576835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:18.577597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:18.578025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:18.609810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:18.610425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:18.617788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:18.618082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:18.619085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:18.619085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:18.651534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:18.666751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:18.669730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:18.671992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a60fa94a-7489-42a5-9b69-563b63946ab7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.107911 Jun 29 10:24:18.672967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 957/1992] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:18.685719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:18.694462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94cdf3a2-bd3b-4fae-8d38-ad4e4d03b6ad tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.088521 Jun 29 10:24:18.695084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1036/1993] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:19.333753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:19.334244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:19.341503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:19.341981 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:19.342924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:19.343410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:19.346337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:19.486582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:19.495025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-022667d5-8891-4e72-94a2-07f286330032 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165867 Jun 29 10:24:19.495585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 958/1994] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:19 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:19.701922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:19.702930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:19.712974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:19.713548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:19.713690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:19.713802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:19.714458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:19.715725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:19.720598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:19.721083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:19.721860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:19.722295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:19.786318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:19.787493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:19.796436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-822c1d80-8629-4d8d-bc8a-234ec0934780 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087475 Jun 29 10:24:19.797011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 959/1995] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:19.798877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:19.800417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:19.801535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7a3dad39-70d7-44e5-ad4f-92b375834e87 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.105807 Jun 29 10:24:19.802113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1037/1996] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:20.515273 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:20.516175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:20.526027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:20.526824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:20.527635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:20.528038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:20.679263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:20.687898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-22ec4b8e-e107-47f9-82be-826776594d2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178664 Jun 29 10:24:20.688478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 960/1997] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:20 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:20.813813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:20.814797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:20.817159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:20.820198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:20.820793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:20.824085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:20.824575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:20.825454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:20.825956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:20.827262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:20.827707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:20.828489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:20.828954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:20.894787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:20.896308 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:20.903331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-beec73a6-9c45-4027-99ba-2e91f3e5d083 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093534 Jun 29 10:24:20.903951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1038/1998] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:20 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:20.905664 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:20.907185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:20.908379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-69dc30bc-ae8b-402a-9087-7102d670d4e6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092196 Jun 29 10:24:20.908860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 961/1999] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:24:21.707919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:21.708572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:21.717292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:21.717566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:21.718528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:21.719058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:21.862794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:21.873819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e17f8a0-e89f-4ed4-9f4f-2afbd3dd3174 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171860 Jun 29 10:24:21.874387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1039/2000] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:21 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:21.920718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:21.921352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:21.927417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:21.928036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:21.929631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:21.930084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:21.930961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:21.931405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:21.934310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:21.934799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:21.935561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:21.935994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:21.951894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:22.001852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:22.004723 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:22.010159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd63fa68-7474-4bcb-9a7b-9ada3aa4a653 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093333 Jun 29 10:24:22.010761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 962/2001] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:22.013930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:22.015441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:22.016599 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-39b9ff81-b8c4-4660-8482-d158fd837f39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093603 Jun 29 10:24:22.017124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1040/2002] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:22.890934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:22.891545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:22.899697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:22.900325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:22.901466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:22.902046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:23.028546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:23.030809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:23.036221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:23.036677 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:23.037451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:23.038001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:23.051724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:23.060373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-497f31b7-6fd9-48b4-bda9-8540489cc287 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173503 Jun 29 10:24:23.061065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 963/2003] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:22 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:23.066253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:23.066889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:23.073136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:23.073595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:23.074418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:23.074902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:23.103574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:23.112878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5ffdfdae-cde2-4dbd-ad45-08fd1fcd2f2b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.088243 Jun 29 10:24:23.113454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1041/2004] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:23.137024 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:23.150161 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:23.152443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:23.156891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aee1eddc-ea64-4e19-a4c3-11453796cfbc tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091715 Jun 29 10:24:23.156891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 964/2005] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:24.077717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:24.078420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:24.085360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:24.085810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:24.086587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:24.087062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:24.130477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:24.131250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:24.138083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:24.139195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:24.139989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:24.140388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:24.205006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:24.213563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-087a0982-9a82-4189-a1a9-9b439b1110b8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086889 Jun 29 10:24:24.214584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 965/2006] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:24:24.223404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:24.223404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:24.229711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:24.230163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:24.230512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:24.230967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:24.231405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:24.238946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-10372247-6df1-4f71-90d8-a188c1dd6518 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165142 Jun 29 10:24:24.239536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1042/2007] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:24 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:24.303818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:24.314025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:24.315933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:24.317107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9d26ee2-9743-4df5-a9e5-0309cd7bf220 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101541 Jun 29 10:24:24.317709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 966/2008] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:25.233814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:25.234468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:25.241868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:25.242307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:25.243105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:25.243544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:25.255857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:25.256514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:25.263469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:25.264183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:25.264695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:25.265131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:25.306338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:25.314843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f4955d12-6a35-4e5a-aa63-4bbd4b1e5577 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086462 Jun 29 10:24:25.315776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1043/2009] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:25 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:25.334759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:25.335683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:25.342672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:25.343127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:25.343912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:25.344350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:25.404067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:25.407323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:25.412307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2bec50bb-bae8-4699-9295-6377a58564f9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160249 Jun 29 10:24:25.413170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 967/2010] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:25 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:25.415733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:25.417201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:25.418366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4bd2f707-0a27-40c9-bb19-3026f2654c93 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087681 Jun 29 10:24:25.418914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1044/2011] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:24:26.333463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:26.334028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:26.340856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:26.341300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:26.342060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:26.342792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:26.415711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:26.426551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b5bc1b99-2f60-4650-84ba-20ed6ac987b2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.097070 Jun 29 10:24:26.427378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 968/2012] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:26 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:26.429552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:26.430177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:26.436826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:26.437446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:26.437604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:26.438057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:26.438856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:26.439295 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:26.444144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:26.444597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:26.445389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:26.445825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:26.514715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:26.523555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:26.525049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:26.526204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5855745a-84ba-40f5-aa96-515f24ce6ce7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093407 Jun 29 10:24:26.526760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 969/2013] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:26.580565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:26.594451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4cb3072-9c8a-4565-8cbe-7885bedc884c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168131 Jun 29 10:24:26.595518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1045/2014] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:26 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:26.770977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:24:26.771258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:24:27.446552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:27.447484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:27.455702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:27.456149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:27.456908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:27.457334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:27.520154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:27.528469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-27c162f3-b2cb-435f-b7f8-5f00f091ead7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087155 Jun 29 10:24:27.529015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 970/2015] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:27.545564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:27.546751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:27.553304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:27.553743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:27.554511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:27.554969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:27.617019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:27.617757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:27.624955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:27.628044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:27.628607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:27.629493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:27.629923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:27.634435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:27.635970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:27.637148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1e70b80c-8ce2-4626-b2d1-953df2a67b7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095584 Jun 29 10:24:27.637720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1046/2016] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:27 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:27.790511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:27.799083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6ae3e76-b165-4249-938c-d0bfe8cbad94 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185928 Jun 29 10:24:27.799611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 971/2017] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:27 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:28.545543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:28.546155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:28.552817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:28.553244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:28.554039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:28.554476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:28.620001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:28.628955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bd85b74a-2484-4bc2-8db6-b430a986c152 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087356 Jun 29 10:24:28.629564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1047/2018] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:28.655627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:28.656201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:28.663029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:28.663507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:28.664362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:28.664717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:28.725863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:28.735317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:28.736420 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:28.737579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5e315907-1384-4483-94e4-f8cd0e5efb58 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.086055 Jun 29 10:24:28.738141 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 972/2019] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:28.819173 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:28.819885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:28.827732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:28.828184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:28.828948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:28.829386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:28.989498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:28.998202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-267a2c6a-fa77-4e60-9a8e-0b7b42c9b596 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185465 Jun 29 10:24:28.998934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1048/2020] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:28 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:29.645851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:29.646483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:29.652946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:29.653395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:29.654156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:29.654592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:29.724187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:29.735945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e3496aac-4c81-4cf3-9606-bbea8d7707b7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.094104 Jun 29 10:24:29.736513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 973/2021] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:29 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:29.759636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:29.760216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:29.767786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:29.768261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:29.769023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:29.769485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:29.833195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:29.846001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:29.848178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:29.849829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7126a997-45e4-40ed-8f70-8ac9f5cddb30 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093943 Jun 29 10:24:29.850513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1049/2022] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:30.020820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:30.021495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:30.031174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:30.031620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:30.032401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:30.032826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:30.172466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:30.175835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:30.185702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9223fe7e-2007-47ce-a32a-647a43c136da tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172377 Jun 29 10:24:30.186464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 974/2023] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:30 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:30.753942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:30.754693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:30.762043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:30.762736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:30.763350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:30.763800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:30.828276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:30.836538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5e88e6bd-f3de-4b9d-9f8d-2ad852395c80 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.087060 Jun 29 10:24:30.837079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1050/2024] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:30.871033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:30.871695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:30.879810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:30.880264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:30.881054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:30.881485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:30.952247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:30.961300 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:30.962836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:30.963997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2922e3fd-4289-4030-a075-58d09a11b38b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099027 Jun 29 10:24:30.964564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 975/2025] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:31.205314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:31.205937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:31.212278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:31.212742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:31.213478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:31.213931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:31.361055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:31.370867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-00f5e12d-5933-4ce9-8b2e-8302bbf79225 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170777 Jun 29 10:24:31.371420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1051/2026] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:31 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:31.854056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:31.854655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:31.861490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:31.861936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:31.862698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:31.863159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:31.926242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:31.934605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-50d719b1-d305-4182-b6ab-4aed61a36cd1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.084556 Jun 29 10:24:31.935169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 976/2027] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:31.984920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:31.985537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:31.992551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:31.993002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:31.993760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:31.994194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:32.057204 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:32.066860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:32.068336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:32.069480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4a092c8-8c36-4b01-b7e1-44933ab9d4d2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090703 Jun 29 10:24:32.070039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1052/2028] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:32.389787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:32.390357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:32.397645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:32.398169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:32.399110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:32.399599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:32.540754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:32.551914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb1bc034-c261-48d2-87cb-1d234de85c18 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166453 Jun 29 10:24:32.552710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 977/2029] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:32 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:32.956473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:32.957392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:32.967084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:32.967767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:32.968921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:32.970097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:33.033512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:33.041918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b06f4b44-eaee-4a1d-bbf5-a2ed6a7827e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.092327 Jun 29 10:24:33.042726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1053/2030] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:32 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:33.088347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:33.088994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:33.097255 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:33.097703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:33.098460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:33.098915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:33.172514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:33.183561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:33.185107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:33.186972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5e74314-6b25-4a88-adde-97cf9ab727b1 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102269 Jun 29 10:24:33.187744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 978/2031] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:33.570426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:33.571057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:33.577561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:33.577982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:33.578810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:33.579470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:33.726421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:33.734807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63ff3aa4-6947-4b0c-a458-a2ed283832c0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168320 Jun 29 10:24:33.736264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1054/2032] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:33 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:34.062862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:34.064036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:34.072470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:34.072925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:34.073708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:34.074140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:34.136894 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:34.146307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f301b85a-c2fe-4945-91b2-38b5a9ea7022 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090389 Jun 29 10:24:34.146934 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 979/2033] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:34.210315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:34.210966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:34.217842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:34.218291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:34.219392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:34.219815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:34.286798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:34.295693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:34.297201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:34.298349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f818fd51-d8e3-45d5-bb0c-706d56643d4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092076 Jun 29 10:24:34.298942 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1055/2034] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:34.755153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:34.755773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:34.762076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:34.762536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:34.763340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:34.763781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:34.907444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:34.919496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8f5647a-e86c-4b40-b37e-02a982540e9c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169494 Jun 29 10:24:34.920216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 980/2035] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:34 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:35.164344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:35.165073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:35.171560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:35.172645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:35.173079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:35.173521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:35.241098 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:35.249699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-07c49f49-13c7-439e-afad-e2a87650655b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089271 Jun 29 10:24:35.250277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1056/2036] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:35 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:35.319918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:35.320511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:35.327703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:35.330111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:35.330111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:35.330111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:35.394513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:35.408328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:35.410187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:35.411383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7e57972-d6e5-4342-aaa8-b35aba4ea133 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097537 Jun 29 10:24:35.411942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 981/2037] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:35.937460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:35.938072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:35.945105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:35.945551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:35.946312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:35.946789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:35.949328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:36.088924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:36.099218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-de15a795-f7bf-4742-b7de-475de6061e38 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165708 Jun 29 10:24:36.099803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1057/2038] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:35 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:36.270202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:36.270844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:36.277329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:36.277775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:36.278520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:36.279013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:36.346796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:36.355067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8043ff92-4959-43e4-ba57-7f0c113953a6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090224 Jun 29 10:24:36.355632 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 982/2039] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:36 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:36.430463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:36.431094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:36.438335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:36.438819 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:36.439585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:36.440681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:36.513086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:36.522465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:36.524003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:36.525149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-344a87ea-dd75-4340-b21a-1269eb67a03f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.098683 Jun 29 10:24:36.525698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1058/2040] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:37.117915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:37.118506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:37.125138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:37.125588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:37.126352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:37.126825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:37.283344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:37.293049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-760952f5-e98a-4bfc-a7fa-cc6381d295a4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.178960 Jun 29 10:24:37.293648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 983/2041] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:37 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:37.372678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:37.373213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:37.381469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:37.381906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:37.382720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:37.383170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:37.449154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:37.458516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-811b9b8f-4819-4f97-834b-599e32abf9e5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089986 Jun 29 10:24:37.459111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1059/2042] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:37.543835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:37.544456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:37.551629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:37.552084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:37.552858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:37.553305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:37.868442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:37.882348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:37.884822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:37.886686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd62e2aa-0a64-43d1-8c34-a9fb717e1acf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.346582 Jun 29 10:24:37.887580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 984/2043] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:37 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:38.311866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:38.312442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:38.320126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:38.320573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:38.321327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:38.321759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:38.476995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:38.477320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:38.477929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:38.484784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:38.485496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:38.486666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:38.486788 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d2cd423c-34f5-4b38-bbd8-6c093c343e4d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179175 Jun 29 10:24:38.487229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:38.487593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1060/2044] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:38 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:38.552395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:38.564467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26779ca7-9808-4438-89e5-5bb95abf8f62 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.092262 Jun 29 10:24:38.565533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 985/2045] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:38 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:39.038856 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:39.039552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:39.046122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:39.046584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:39.047365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:39.047872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:39.118111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:39.127039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:39.128563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:39.129717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-15b1ac8c-a155-424b-88c0-c448d3bee18c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.225110 Jun 29 10:24:39.130381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1061/2046] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:39.505890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:39.506574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:39.515577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:39.516175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:39.517223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:39.517761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:39.586939 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:39.587571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:39.594058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:39.594505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:39.595313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:39.595741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:39.665620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:39.673969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a99ed85-3cf0-4ed4-9625-65b23c45da82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.091448 Jun 29 10:24:39.674539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1062/2047] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:39.792493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:39.801199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c19e0b82-e610-41af-90c4-f0d64c00bca5 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.299971 Jun 29 10:24:39.801772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 986/2048] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:39 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:40.149484 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:40.150089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:40.157072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:40.157551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:40.158364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:40.158865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:40.295762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:40.308803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:40.311201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:40.312837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3686da1-0399-4478-b42a-823c31aac86b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.167934 Jun 29 10:24:40.313645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1063/2049] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:40.692489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:40.693119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:40.700727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:40.701174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:40.701938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:40.702366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:40.768964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:40.778656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f37dabf-7d8e-4ca5-b558-b742b9c37e47 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090363 Jun 29 10:24:40.779204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 987/2050] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:40.819778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:40.820384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:40.830124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:40.830820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:40.832023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:40.832600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:40.977421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:40.989578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-850109e8-dfb4-4a9e-bb40-671d5f985490 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174316 Jun 29 10:24:40.990422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1064/2051] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:41.333773 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:41.334361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:41.336563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=84 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:41.342231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:41.342735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:41.343499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:41.343940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:41.407896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:41.417023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:41.418599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:41.419761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26b0056b-b025-4f21-a78e-3b6a7b110e19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090093 Jun 29 10:24:41.420317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 988/2052] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:41.795914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:41.796559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:41.803146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:41.803694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:41.804457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:41.804893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:41.872536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:41.881202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e38576f4-6f84-45ff-9898-efb0d2f81eb9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089284 Jun 29 10:24:41.881859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1065/2053] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:41 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:42.007679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:42.008194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:42.015279 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:42.015732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:42.016498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:42.016961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:42.156756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:42.168545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-48b3c545-700a-48c2-9ff7-4bfd704ef0eb tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165270 Jun 29 10:24:42.169432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 989/2054] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:42 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:42.437701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:42.438314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:42.445332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:42.445791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:42.446554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:42.447020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:42.519355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:42.532935 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:42.535252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:42.536917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-15b067a0-939b-4975-a0d8-ba79f5694048 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103009 Jun 29 10:24:42.537642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1066/2055] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:42.898904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:42.899483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:42.908801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:42.909307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:42.910343 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:42.910987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:42.982183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:42.990839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c2e0c6dc-e570-43da-b8d2-964f48a3b2b9 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.096100 Jun 29 10:24:42.991433 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 990/2056] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:42 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:43.189152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:43.190155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:43.197435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:43.197879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:43.198689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:43.199118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:43.347912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:43.356395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fa147c53-b7be-43ba-bb02-19ca86b17ae1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171222 Jun 29 10:24:43.356959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1067/2057] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:43 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:43.556805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:43.557372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:43.565351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:43.565841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:43.566746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:43.567207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:43.582517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:43.630156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:43.641989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:43.643560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:43.644697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7774b7c1-d432-4938-8fbd-1d08df0864ca tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092418 Jun 29 10:24:43.645244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 991/2058] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:43 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:44.009616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:44.010228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:44.016776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:44.017220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:44.017980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:44.018409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:44.082349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:44.090852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f7f9393e-fd60-4389-a561-23b4326f6086 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086037 Jun 29 10:24:44.091428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1068/2059] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:44 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:44.374677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:44.375260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:44.382759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:44.383214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:44.383984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:44.384417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:44.520743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:44.529417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc0c25e4-63ae-4f63-8d5a-edbc80b87d40 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.159614 Jun 29 10:24:44.529990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 992/2060] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:44 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:44.664293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:44.664878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:44.672370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:44.672817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:44.673573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:44.674006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:44.743498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:44.756327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:44.758057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:44.759245 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1d2e7cda-009f-49ec-9144-b1bc2c8df7a7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099567 Jun 29 10:24:44.759824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1069/2061] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:44 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:45.110055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:45.110749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:45.121242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:45.121887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:45.123125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:45.123695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:45.191489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:45.200041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-24dcad60-9d7e-40ed-80dd-a483b3b3fb1a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095712 Jun 29 10:24:45.200616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 993/2062] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:45 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:45.547329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:45.547943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:45.554405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:45.554889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:45.555655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:45.556088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:45.701679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:45.713760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a5131ae2-21f9-4a04-8dcd-c713b57fddd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170137 Jun 29 10:24:45.714479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1070/2063] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:45 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:45.777899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:45.778547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:45.785061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:45.785513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:45.786286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:45.786748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:45.865515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:45.877327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:45.879610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:45.881252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7bda5fee-1c81-499b-bb09-dd0e5e561215 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.107268 Jun 29 10:24:45.881949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 994/2064] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:45 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:46.218650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:46.219274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:46.226150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:46.226594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:46.227406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:46.227847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:46.302296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:46.314326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1edf2b71-2438-4d55-8ea7-97a6e007df82 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.099259 Jun 29 10:24:46.315490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1071/2065] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:46 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:46.735270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:46.736169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:46.745239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:46.745685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:46.746448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:46.746909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:46.895295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:46.904394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:46.905471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:46.908789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-46330fc1-d473-48e1-8185-2e9c47a5217c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179885 Jun 29 10:24:46.909754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 995/2066] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:46 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:46.916311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:46.917107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:46.918466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:46.919270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:46.986503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:46.995528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:46.997002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:46.998137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2da4aec3-5ba6-4b02-ade9-af1f5ecee6ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100258 Jun 29 10:24:46.998716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1072/2067] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:46 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:47.336652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:47.337206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:47.345901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:47.346413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:47.347584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:47.348195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:47.411891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:47.420460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2a10dea-beb1-43fd-8a35-4a5274d1f862 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089731 Jun 29 10:24:47.421022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 996/2068] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:47 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:47.936001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:47.936655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:47.943630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:47.944203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:47.944983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:47.945412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:48.016568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:48.017230 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:48.024297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:48.024754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:48.025529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:48.025976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:48.091418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:48.093925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:48.096150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:48.099783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:48.101336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:48.102518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fc1cec62-d659-4c4b-b23d-af884c0a869c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090080 Jun 29 10:24:48.103112 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 997/2069] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:48 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:48.103792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8cd07f38-f677-4260-b4d4-dbf2d5176a4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174020 Jun 29 10:24:48.104367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1073/2070] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:47 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:48.440506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:48.441339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:48.450213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:48.450769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:48.451875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:48.452490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:48.520254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:48.529730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5a490b28-c4b0-44ed-a091-6e5bd2614c54 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095095 Jun 29 10:24:48.530314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 998/2071] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:48 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:49.120887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:49.121507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:49.121507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:49.121991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:49.128253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:49.128711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:49.128830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:49.129167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:49.129471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:49.129908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:49.130036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:49.130342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:49.193671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:49.202556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:49.204120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:49.205270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f17808d8-6837-4e6f-8a42-8baba88e3c0e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.088272 Jun 29 10:24:49.206043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 999/2072] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:49 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:24:49.262642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:49.275767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19eebf0c-6b9b-42b8-909d-a4a25d658ab4 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158552 Jun 29 10:24:49.276623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1074/2073] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:49 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:49.552013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:49.552619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:49.559847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:49.560288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:49.561052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:49.561479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:49.625948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:49.634513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de587119-a76b-4fec-ba0f-902b5507432c tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086423 Jun 29 10:24:49.635121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1000/2074] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:49 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:50.225889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:50.226547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:50.233671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:50.234125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:50.234941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:50.235380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:50.297681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:50.298304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:50.307042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:50.307042 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:50.307749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:50.308814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:50.309179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:50.319039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:50.320815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:50.322003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6f3ed96a-844a-43d5-8be4-e3ee3c9272e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102289 Jun 29 10:24:50.322591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1075/2075] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:50 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:50.444438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:50.454347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-22602b79-22c3-485d-9ab2-4ec8dd5c4bb0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160511 Jun 29 10:24:50.454966 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1001/2076] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:50 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:50.652520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:50.653012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:50.659738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:50.660180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:50.660934 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:50.661371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:50.735925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:50.748878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-43f1f56a-4768-4050-b8de-5c9ac96170fc tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.100485 Jun 29 10:24:50.749824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1076/2077] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:50 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:51.341425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:51.341992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:51.349004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:51.349499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:51.350254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:51.350705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:51.417468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:51.426382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:51.427921 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:51.429055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa62fd88-e9c4-4f12-913c-c020980900cd tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091830 Jun 29 10:24:51.429720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1002/2078] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:51 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:51.474981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:51.475565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:51.479735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:51.487291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:51.487945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:51.489153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:51.489836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:51.644103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:51.656573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7a2a34d-f3a4-4288-91bf-2395fb24e291 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.187386 Jun 29 10:24:51.657466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1077/2079] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:51 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:51.768872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:51.769492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:51.776096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:51.776550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:51.777324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:51.777761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:51.840691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:51.849203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f64e0fa0-6aaf-4ef5-9761-192e056dd721 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.084245 Jun 29 10:24:51.849769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1003/2080] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:51 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:52.447919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:52.448536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:52.454779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:52.455233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:52.456086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:52.456653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:52.525928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:52.534910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:52.536437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:52.537618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d1ea4bba-e6e2-4ce2-a9a0-52619c603086 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094108 Jun 29 10:24:52.538197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1078/2081] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:52 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:52.677386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:52.677945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:52.685055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:52.685509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:52.686271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:52.686747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:52.836551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:52.844918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-22f6493b-bfcf-4283-8d6b-a2781b74afbe tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171728 Jun 29 10:24:52.845483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1004/2082] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:52 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:52.867895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:52.868627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:52.875272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:52.875684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:52.876438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:52.876877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:52.950344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:52.959066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e4d31b09-16a5-4b8c-af42-57111c2f93f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095771 Jun 29 10:24:52.959636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1079/2083] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:52 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:53.557686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:53.558298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:53.565189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:53.565647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:53.566423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:53.566890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:53.632871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:53.642038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:53.643569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:53.644766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b29720fa-7d7b-48a1-92b6-6288b2ccf05d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091565 Jun 29 10:24:53.645336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1005/2084] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:53 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:53.865622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:53.866206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:53.875328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:53.876132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:53.877476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:53.878258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:53.978101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:53.978749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:53.985817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:53.986263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:53.987054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:53.987491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:54.031279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:54.040018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c5fc70d1-1e55-47ea-a973-1d7980f4397c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179901 Jun 29 10:24:54.049470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1080/2085] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:53 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:54.050475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:54.063238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3fd19266-2ba0-4a48-9c51-e0fb46a9ab10 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089089 Jun 29 10:24:54.064008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1006/2086] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:53 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:54.665121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:54.666548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:54.672251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:54.672699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:54.673450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:54.673874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:54.749618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:54.759023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:54.760602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:54.761762 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b660ae63-4dfc-40c1-8138-faaee9551918 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102380 Jun 29 10:24:54.762333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1081/2087] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:54 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:55.058153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:55.058856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:55.066266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:55.066750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:55.067525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:55.067954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:55.082694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:55.083314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:55.090641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:55.091095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:55.091895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:55.092330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:55.157573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:55.165802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3548071b-5b9c-4bb8-96f3-9ff5619cbbf2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086950 Jun 29 10:24:55.166386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1082/2088] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:55 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:55.206869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:55.215434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d0e449be-2bbf-4458-a4df-65ba2e166c88 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161671 Jun 29 10:24:55.215986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1007/2089] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:55 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:55.780388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:55.780995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:55.787681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:55.788130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:55.788929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:55.789362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:55.859328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:55.867919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:55.869864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:55.871260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d6e08991-2ea4-48dd-81cc-8dcb8291a7eb tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094829 Jun 29 10:24:55.871845 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1083/2090] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:55 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:56.184126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:56.184752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:56.192514 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:56.192960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:56.193726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:56.194147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:56.197274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:24:56.232832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:56.233449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:56.240574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:56.241194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:56.241817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:56.242474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:56.269227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:56.277821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-553c6b62-7bf1-46e9-966c-beb84570da5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.098072 Jun 29 10:24:56.278370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1008/2091] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:56 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:56.293303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:24:56.293556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:24:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:24:56.381834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:56.395896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8f468324-f324-4d47-b7be-797cfcabdea2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166749 Jun 29 10:24:56.396800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1084/2092] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:56 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:56.889700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:56.890317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:56.896914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:56.897383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:56.898139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:56.898601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:56.969404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:56.978695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:56.980195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:56.981347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-316418bd-cd19-4e8b-9261-937279055af3 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095689 Jun 29 10:24:56.981901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1009/2093] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:56 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:57.294840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:57.295467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:57.302509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:57.303041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:57.303815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:57.304318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:57.370445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:57.378962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-882696ea-62f5-4c67-9402-77b7724ed7bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.088126 Jun 29 10:24:57.379526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1085/2094] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:57 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:57.414717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:57.415348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:57.422701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:57.423131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:57.423901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:57.424334 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:57.570315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:57.578931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-154f1c74-a885-4e2b-befa-e0587ac4fe45 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168159 Jun 29 10:24:57.579500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1010/2095] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:57 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:58.000104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:58.000611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:58.007077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:58.007524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:58.008276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:58.008704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:58.076301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:58.085386 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:58.086906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:58.088171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f39cef7f-604a-4e41-8eac-a56828beae4a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092180 Jun 29 10:24:58.088732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1086/2096] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:57 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:58.401124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:58.401608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:58.408755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:58.409208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:58.409967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:58.410407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:58.477663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:58.486592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-827c62a2-de84-4180-87b4-a3338c99a488 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089941 Jun 29 10:24:58.487197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1011/2097] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:58 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:58.598285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:58.599010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:58.607908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:58.608470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:58.609519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:58.610089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:58.752969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:58.763629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0e67acfe-56dc-460e-985f-9a8468ee1257 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170542 Jun 29 10:24:58.764201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1087/2098] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:58 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:59.107411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:59.108025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:59.114595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:59.115095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:59.115878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:59.116309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:59.187813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:59.197919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:59.199506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:59.200660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7b8fff3-fe20-4ae4-8455-89bf6fc3ba55 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097473 Jun 29 10:24:59.201191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1012/2099] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:24:59 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:24:59.506742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:59.507515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:59.516390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:59.516969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:59.518104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:59.518683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:59.588697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:59.596996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a19410ae-840b-4bc8-ab89-120aee9d2703 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.096158 Jun 29 10:24:59.597597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1088/2100] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:59 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:24:59.784802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:24:59.785320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:24:59.792683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:59.793133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:59.793900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:24:59.794330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:24:59.933105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:24:59.941726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8300caa9-c6c3-42d9-933f-23268b9c4192 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160970 Jun 29 10:24:59.942292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1013/2101] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:24:59 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:00.219494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:00.220144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:00.227212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:00.227667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:00.228476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:00.228928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:00.296644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:00.305858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:00.307552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:00.308765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ed1a92d9-b93e-4f8b-9e6e-e25452b0be71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093192 Jun 29 10:25:00.309258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1089/2102] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:00 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:00.615702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:00.616425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:00.624746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:00.625299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:00.626264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:00.626907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:00.693979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:00.703518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-76c19173-d559-46e7-93f5-e870ba9b5b94 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093006 Jun 29 10:25:00.704096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1014/2103] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:00 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:00.958499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:00.959150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:00.966174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:00.966672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:00.967436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:00.967870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:00.983114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:01.117921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:01.126814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9ff8ffdd-022b-4d13-806d-c6d9241f7c6c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.172244 Jun 29 10:25:01.127514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1090/2104] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:00 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:01.328730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:01.329326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:01.338649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:01.339290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:01.340328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:01.340956 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:01.420647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:01.433680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:01.436000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:01.437737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7f6dc66b-9d3f-4c1e-8c3a-ff569378855f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114718 Jun 29 10:25:01.438505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1015/2105] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:01 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:01.723521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:01.724290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:01.733340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:01.733941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:01.735023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:01.735598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:01.801191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:01.812237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-534d27a2-f6e4-4f43-a03b-8645f0ccdbe7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093748 Jun 29 10:25:01.813049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1091/2106] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:01 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:02.143913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:02.144527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:02.152238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:02.152866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:02.153712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:02.154153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:02.316574 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:02.325520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-29bb2cd1-7c93-405d-8fb0-413d8939ac4a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.185477 Jun 29 10:25:02.326099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1016/2107] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:02 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:02.460611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:02.461433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:02.469444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:02.469892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:02.470722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:02.471158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:02.545121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:02.554471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:02.556243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:02.557366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c1755161-9a2f-4e87-b235-9011e0f95779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101886 Jun 29 10:25:02.558134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1092/2108] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:02 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:25:02.829629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:02.830256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:02.837595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:02.838048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:02.838869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:02.839305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:02.910835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:02.920065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5fef77ce-56fe-4a11-9740-760d5d0659bd tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.094391 Jun 29 10:25:02.920599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1017/2109] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:02 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:03.344112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:03.344821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:03.352662 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:03.353202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:03.354167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:03.354690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:03.496614 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:03.508088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-092cd7b1-0936-4878-953c-5bc3f6d3f87a tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168091 Jun 29 10:25:03.508778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1093/2110] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:03 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:03.576233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:03.576866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:03.583565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:03.584014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:03.584781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:03.585228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:03.660620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:03.669423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:03.670953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:03.672119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f49d086c-6c93-453e-91bd-2465d9f7c320 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099933 Jun 29 10:25:03.672681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1018/2111] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:03 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:03.937434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:03.938110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:03.946324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:03.947020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:03.948247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:03.948933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:04.032269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:04.040975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2729555b-60cc-4e94-bb85-b0a5c1ff0ad0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.107363 Jun 29 10:25:04.041531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1094/2112] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:03 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:04.526555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:04.527434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:04.535198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:04.535711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:04.536555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:04.537050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:04.683000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:04.689428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:04.690441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:04.692520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8f85257f-24cb-4a6b-beca-cfe101c51d6b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.170703 Jun 29 10:25:04.693191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1019/2113] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:04 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:04.697242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:04.698706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:04.699843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:04.700280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:04.765097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:04.774214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:04.775782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:04.776979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-948d9cc9-6e42-41e1-81a6-37bdc394406d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091422 Jun 29 10:25:04.777465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1095/2114] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:04 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:25:05.057831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:05.058451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:05.065814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:05.066260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:05.067332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:05.067770 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:05.129906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:05.139250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2efac327-5a23-4c41-aadb-4f8a922b5957 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085632 Jun 29 10:25:05.139822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1020/2115] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:05 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:05.710181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:05.710846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:05.717969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:05.718414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:05.719209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:05.719635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:05.796338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:05.796928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:05.803622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:05.804064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:05.804808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:05.805232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:05.859331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:05.867670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dd18ff53-10de-4dc5-abbe-6385a0fdfb58 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161423 Jun 29 10:25:05.868257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1096/2116] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:05 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:05.869931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:05.878994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:05.880478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:05.881620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c89a8b97-7b42-412a-b4e7-aa1403e242ad tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089759 Jun 29 10:25:05.882232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1021/2117] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:05 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:25:06.159331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:06.159970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:06.167831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:06.168279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:06.169317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:06.169958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:06.244519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:06.255307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ad992aa8-31aa-4c5f-8621-ffe790e2d7ac tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.101919 Jun 29 10:25:06.255897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1097/2118] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:06 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:06.888509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:06.889157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:06.899843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:06.900637 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:06.901285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:06.901807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:06.901951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:06.902238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:06.909756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:06.910470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:06.911642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:06.912109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:06.985154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:06.994274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:06.995833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:06.996991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19d506ca-1ac3-4725-98fa-3f058cdb6fe2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100707 Jun 29 10:25:06.997555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1098/2119] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:06 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:07.061370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:07.070247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a95ca5bb-59c4-47ca-9579-c1056a765441 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.188002 Jun 29 10:25:07.070891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1022/2120] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:06 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:07.273652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:07.274290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:07.281199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:07.281647 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:07.282421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:07.282888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:07.358045 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:07.367671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-003485c6-c99c-4237-beea-596a0ae9411f tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.097725 Jun 29 10:25:07.368364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1099/2121] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:07 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:08.023530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:08.024330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:08.033676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:08.034302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:08.035408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:08.036011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:08.087070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:08.087735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:08.094654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:08.095099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:08.095876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:08.096310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:08.101916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:08.110612 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:08.112136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:08.113292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3e23588e-a6da-43e9-824d-df03177afb77 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095372 Jun 29 10:25:08.113847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1023/2122] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:08 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:08.233482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:08.246512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b0c01d5d-9518-4f60-aa96-e63c65876f60 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163323 Jun 29 10:25:08.247505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1100/2123] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:08 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:08.391919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:08.392448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:08.402739 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:08.403362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:08.404135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:08.404561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:08.476742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:08.479580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:08.486903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9af70aea-7e8e-4134-9f96-948137e89142 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.103354 Jun 29 10:25:08.487469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1024/2124] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:08 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:09.131860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:09.132498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:09.140082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:09.140549 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:09.141336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:09.141764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:09.208906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:09.219218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:09.220698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:09.221833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2772f7ff-cf9e-4e29-8f67-2e926c2b1cb4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094036 Jun 29 10:25:09.222403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1101/2125] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:09 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:09.269003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:09.269599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:09.277256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:09.277701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:09.278470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:09.278942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:09.435354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:09.445793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0d9396f5-08fc-4288-bb43-967f2de4ccbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.180401 Jun 29 10:25:09.446616 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1025/2126] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:09 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:09.508607 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:09.509520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:09.517416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:09.518008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:09.518901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:09.519373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:09.583836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:09.592393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ea86f722-2d92-4d7b-a495-a902b98b99b0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090118 Jun 29 10:25:09.593018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1102/2127] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:09 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:10.244475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:10.245135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:10.255126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:10.255329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:10.256292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:10.256977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:10.330009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:10.339077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:10.340569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:10.341721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ccda963a-f525-40ce-b8a8-0b5a808f701a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.104069 Jun 29 10:25:10.342271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1026/2128] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:10 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:10.469408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:10.470010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:10.478301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:10.478829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:10.480188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:10.480621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:10.612482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:10.613087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:10.619497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:10.620169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:10.621137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:10.621566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:10.639800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:10.648664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-181fc4c5-fab6-44ff-b036-b5663cc1a707 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.184426 Jun 29 10:25:10.649273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1103/2129] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:10 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:10.684108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:10.692884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3a3539e4-cb2b-444b-a568-e12f40dc2b8a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086496 Jun 29 10:25:10.693447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1027/2130] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:10 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:11.360060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:11.360578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:11.367164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:11.367588 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:11.368355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:11.368790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:11.432663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:11.442431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:11.443958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:11.445129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-be98e5e0-74ed-49c4-97b5-2fbed239ef4d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.089154 Jun 29 10:25:11.445658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1104/2131] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:11 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:11.669260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:11.669825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:11.673351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=80 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:11.677182 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:11.677631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:11.678396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:11.678867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:11.716497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:11.717260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:11.724404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:11.725012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:11.725812 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:11.726313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:11.793613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:11.802122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4e92a969-7b40-40d3-9f82-32b6129d39d8 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090387 Jun 29 10:25:11.803181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1105/2132] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:11 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:11.820676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:11.829783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7e53cf19-e73e-4853-b79c-464f6803aa44 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166353 Jun 29 10:25:11.830342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1028/2133] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:11 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:12.464266 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:12.465228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:12.471459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:12.471948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:12.472660 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:12.473096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:12.548956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:12.563471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:12.565620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:12.567374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-81741229-0ab1-4282-b026-9a43e5b03589 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.106902 Jun 29 10:25:12.568079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1106/2134] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:12 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:12.823493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:12.824090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:12.834264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:12.834924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:12.836017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:12.836573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:12.847823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:12.848540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:12.855442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:12.856186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:12.857435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:12.857822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:12.860680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:12.902511 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:12.910727 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce8840af-44ca-4b08-8ca2-732ca26f230a tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093343 Jun 29 10:25:12.911307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1029/2135] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:12 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:12.993456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:13.002318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-67fce62a-6521-479f-88ac-141d154bf6f1 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158453 Jun 29 10:25:13.002932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1107/2136] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:12 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:13.588697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:13.589310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:13.596354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:13.596800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:13.597569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:13.598173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:13.671754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:13.682761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:13.684930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:13.686323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-66b4e1f1-ce58-4c2c-94e0-f7bdf014b3f4 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101650 Jun 29 10:25:13.686915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1030/2137] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:13 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:13.929368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:13.930018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:13.938026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:13.938498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:13.939286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:13.940079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:14.005135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:14.014022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-291d0ff3-9455-45a6-9b92-ffc813cea399 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.088627 Jun 29 10:25:14.014705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1108/2138] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:13 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:14.019763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:14.020381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:14.029029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:14.029545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:14.030624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:14.031331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:14.180626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:14.189206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-01ff4b52-b94a-4825-8aba-a574cced70ae tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.173243 Jun 29 10:25:14.190156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1031/2139] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:14 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:14.706388 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:14.707016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:14.713382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:14.713822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:14.714591 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:14.715046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:14.778461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:14.791320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:14.793532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:14.795754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a144fd58-398c-4ecb-b446-876b6ffee061 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092736 Jun 29 10:25:14.796318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1109/2140] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:14 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:15.032204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:15.032825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:15.039740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:15.040183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:15.040946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:15.041379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:15.105745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:15.117291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b8573a7d-29ed-4398-babd-5e6ef8754976 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089643 Jun 29 10:25:15.118008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1032/2141] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:15 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:15.209789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:15.210410 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:15.217701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:15.218161 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:15.218948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:15.219387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:15.373507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:15.382096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b9467f2c-050c-4b6e-b17b-be489b097286 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.176319 Jun 29 10:25:15.382682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1110/2142] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:15 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:15.817059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:15.817955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:15.826628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:15.827342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:15.828254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:15.828916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:15.890857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:15.900289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:15.901775 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:15.902924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fcb36ed2-db3f-444a-a320-c76d3b03914a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092078 Jun 29 10:25:15.903470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1033/2143] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:15 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:16.136545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:16.137153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:16.144300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:16.144745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:16.145501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:16.145933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:16.211633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:16.221389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7751227-3b74-4d96-a894-850828a9cfea tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.088775 Jun 29 10:25:16.221961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1111/2144] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:16 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:16.407767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:16.408358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:16.415591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:16.416081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:16.416843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:16.417271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:16.581832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:16.590600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3aebfd04-bea0-478d-b302-34e4314611cf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.188744 Jun 29 10:25:16.591293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1034/2145] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:16 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:16.924780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:16.925617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:16.935109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:16.935699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:16.936874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:16.937496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:17.000864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:17.009700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:17.011261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:17.012400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b76a9838-1b53-4b09-8bb8-36aa2eda7154 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093575 Jun 29 10:25:17.012961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1112/2146] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:16 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:17.239485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:17.240098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:17.246656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:17.247107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:17.247868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:17.248292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:17.316898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:17.325676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45e3ddd9-1417-4faf-9140-eb6380659427 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090256 Jun 29 10:25:17.326233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1035/2147] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:17 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:17.608720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:17.609308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:17.616618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:17.617066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:17.617824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:17.618251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:17.771322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:17.784323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-36f9a5e6-5835-423e-bc7a-c1b0cee1ae43 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.179604 Jun 29 10:25:17.784874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1113/2148] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:17 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:18.033728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:18.034358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:18.044028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:18.044490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:18.045256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:18.045688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:18.112948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:18.126854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:18.129406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:18.131224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0228baa-0b8c-44ec-9e8f-b02422a3176c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102963 Jun 29 10:25:18.131988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1036/2149] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:18 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:18.343513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:18.344064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:18.351246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:18.351702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:18.352458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:18.352890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:18.414317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:18.422763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-32e8cdc9-57bc-400a-89c2-b0dfc771e436 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.083250 Jun 29 10:25:18.423357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1114/2150] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:18 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:18.802501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:18.803151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:18.810065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:18.810526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:18.811319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:18.811748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:18.955819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:18.964238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-946409e9-f1b2-4883-8d2b-7cfdc64c0fbd tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.166067 Jun 29 10:25:18.964817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1037/2151] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:18 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:19.153350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:19.153958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:19.161307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:19.161750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:19.162512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:19.162971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:19.232237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:19.242046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:19.243580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:19.244718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c17af4e3-5efe-4381-b78d-75b2f7e8fb27 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095391 Jun 29 10:25:19.245271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1115/2152] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:19 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:19.440879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:19.441486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:19.448235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:19.448690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:19.449455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:19.449885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:19.520048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:19.528518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b7bd02f4-d3ac-4d1e-b841-7320c0685580 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.092201 Jun 29 10:25:19.529106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1038/2153] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:19 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:19.982371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:19.983013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:19.989824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:19.990279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:19.991079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:19.991518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:20.133198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:20.141748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d9cdfaba-1f49-41b8-96ff-763c373edc2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.163291 Jun 29 10:25:20.142338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1116/2154] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:19 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:20.268427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:20.269039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:20.275623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:20.276076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:20.276850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:20.277287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:20.352469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:20.365750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:20.368037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:20.369745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d81462d6-9bc6-4e26-86c5-60062a84a779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.105236 Jun 29 10:25:20.370429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1039/2155] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:20 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:20.547093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:20.547783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:20.555366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:20.555816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:20.556584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:20.556982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:20.629312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:20.640243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fe5a7996-e5fc-4699-98c1-59188b53c79d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.096783 Jun 29 10:25:20.640999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1117/2156] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:20 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:21.159694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:21.160304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:21.167305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:21.167751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:21.168532 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:21.168960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:21.314013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:21.323620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-194d6db2-abf9-481f-8752-605d36d9456e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.167944 Jun 29 10:25:21.324198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1040/2157] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:21 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:21.390178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:21.390835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:21.397690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:21.398102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:21.398917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:21.399325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:21.469477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:21.478722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:21.480216 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:21.481363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3a33470a-cd7a-487b-973c-8cff75f4536b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.095220 Jun 29 10:25:21.481937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1118/2158] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:21 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:21.657469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:21.658082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:21.665199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:21.665643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:21.666405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:21.666878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:21.681641 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:21.733087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:21.743139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7aaee26b-eed3-4259-9f8d-1310bbd3affa tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.089650 Jun 29 10:25:21.743743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1041/2159] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:21 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:22.344557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:22.345149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:22.348118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=84 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:22.353551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:22.353995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:22.354793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:22.355235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:22.499644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:22.500187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:22.501628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:22.507272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:22.507741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:22.508518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:22.508948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:22.509958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2deb6512-38d4-42ec-9e76-6450bb416cd0 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.169388 Jun 29 10:25:22.510524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1119/2160] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:22 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:22.576663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:22.585366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:22.586906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:22.588060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-18e1f03a-d217-4293-abb8-28a06c3014cf tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.092395 Jun 29 10:25:22.588608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1042/2161] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:22 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:22.766401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:22.767291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:22.774171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:22.774661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:22.775407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:22.775835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:22.850553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:22.859131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b320eaf9-ba63-412d-ba8e-0f0b24a620f7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.099273 Jun 29 10:25:22.859701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1120/2162] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:22 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:23.528827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:23.529534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:23.537917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:23.538390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:23.539219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:23.539683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:23.606671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:23.607247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:23.614445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:23.614923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:23.615693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:23.616115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:23.678524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:23.683577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:23.687446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:23.688923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:23.690625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6c6a354c-e40e-479e-a0b5-c47669b37879 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087881 Jun 29 10:25:23.691344 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1121/2163] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:23 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:23.692636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-22651efa-a4bb-4e53-8445-e443343ed44f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.168767 Jun 29 10:25:23.693196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1043/2164] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:23 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:23.877088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:23.877759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:23.884255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:23.884699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:23.885462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:23.885890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:23.954759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:23.963598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-beab3a9e-488b-41e8-9b4c-37d7bfc6cd9d tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.091023 Jun 29 10:25:23.964191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1122/2165] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:23 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:24.710894 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:24.711494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:24.711916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:24.712027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:24.718326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:24.718533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:24.718831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:24.719083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:24.719584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:24.719806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:24.720017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:24.720276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:24.785351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:24.805166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:24.806701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:24.807860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-246ecc81-1566-4495-8dd5-95845ef099d5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.101571 Jun 29 10:25:24.808411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1044/2166] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:24 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:24.874253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:24.879211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:24.891486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4c8a7b21-d495-4a5d-85d4-2863f98e5364 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.184314 Jun 29 10:25:24.892380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1123/2167] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:24 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:24.982037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:24.982613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:24.990293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:24.990792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:24.991535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:24.991968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:25.063905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:25.072662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-763e08ff-0abf-41e2-b6b0-2ff8a0646f85 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.095346 Jun 29 10:25:25.073194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1045/2168] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:24 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:25.830937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:25.831799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:25.842873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:25.843517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:25.844777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:25.845470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:25.911594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:25.912243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:25.919613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:25.920056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:25.920814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:25.921250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:25.927273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:25.936374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:25.938031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:25.939571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d1f753ad-772a-4ce6-8c52-074c94fefb85 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.114923 Jun 29 10:25:25.940154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1124/2169] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:25 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:26.053128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:26.061656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-264651d7-d879-4bd3-8e4f-be5eb7106337 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.155598 Jun 29 10:25:26.062323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1046/2170] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:25 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:26.092362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:26.093371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:26.100877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:26.101334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:26.102108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:26.102553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:26.165004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:26.176476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5d30c467-23ba-4363-99c9-54db094d04e4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.090502 Jun 29 10:25:26.177046 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1125/2171] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:26 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:26.962105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:26.963155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:26.972708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:26.973253 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:26.974425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:26.975012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:27.044184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:27.053459 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:27.054983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:27.056225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-144f23ee-d372-493d-9f05-3b37f8ef4b12 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100537 Jun 29 10:25:27.056667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1047/2172] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:26 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:27.080076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:27.080656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:27.087680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:27.088124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:27.088880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:27.089311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:27.194068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:27.194708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:27.201395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:27.201883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:27.202679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:27.203116 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:27.229519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:27.237873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e0c94bb3-56c6-4477-b468-1c09375f74b2 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161582 Jun 29 10:25:27.238933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1126/2173] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:27 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:27.263953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:27.272556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0277185c-5dbb-49d4-a44f-cb6e1f6420d1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.082394 Jun 29 10:25:27.273118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1048/2174] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:27 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:28.074604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:28.075247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:28.081845 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:28.082689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:28.083188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:28.083627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:28.149628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:28.158387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:28.159910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:28.161124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-eea3cd0b-73db-42e0-9b6b-796f6bd98fce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.090525 Jun 29 10:25:28.161664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1127/2175] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:28 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:28.256549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:28.257171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:28.264726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:28.265423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:28.266522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:28.266985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:28.290403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:28.291057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:28.297832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:28.298372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:28.299133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:28.299602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:28.362199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:28.370391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7012dd0c-0591-4ba3-ac43-27bc722be628 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.084561 Jun 29 10:25:28.371013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1128/2176] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:28 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:28.417706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:28.426296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b30eb03-8b7b-40e8-a703-4236512b8779 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174509 Jun 29 10:25:28.426916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1049/2177] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:28 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:29.181446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:29.182048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:29.189474 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:29.189933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:29.190726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:29.191166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:29.251627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:29.260466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:29.261947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:29.263133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70d7f85e-6368-4db9-a7ed-7f50a9cd21c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.087354 Jun 29 10:25:29.263688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1129/2178] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:29 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:29.387074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:29.387617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:29.397023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:29.397469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:29.398226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:29.398692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:29.444838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:29.445610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:29.452152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:29.452604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:29.453335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:29.453800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:29.461394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:29.469855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2bfadafa-f845-416d-81a6-5ac681b64ee5 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.086701 Jun 29 10:25:29.470497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1050/2179] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:29 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:29.590004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:29.598664 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-34378805-244f-42f7-a1e9-9c911d5f4a21 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.158289 Jun 29 10:25:29.599239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1130/2180] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:29 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:25:30.281238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:30.281849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:30.288783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:30.289237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:30.289996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:30.290431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:30.356792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:30.365772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:30.367321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:30.368509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-84126d4a-11b8-4e42-af15-cdb36587e3c5 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.091254 Jun 29 10:25:30.369087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1051/2181] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:30 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:30.487449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:30.488114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:30.495055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:30.495512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:30.496279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:30.496719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:30.558555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:30.567217 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4648c225-6d18-4b0b-9f55-a22021fab833 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.083701 Jun 29 10:25:30.567790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1131/2182] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:30 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:30.616023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:30.616545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:30.623236 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:30.623692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:30.624455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:30.624890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:30.763557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:30.772540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efdc9625-8015-48bc-acfd-d5967ab994a7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.160569 Jun 29 10:25:30.773111 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1052/2183] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:30 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:31.390338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:31.391187 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:31.401450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:31.402210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:31.403534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:31.404304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:31.470308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:31.479178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:31.480699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:31.481886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e795eeb-7fb3-4ce4-9c9e-d82ec2a23d35 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.097760 Jun 29 10:25:31.482467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1132/2184] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:31 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:31.589283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:31.590444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:31.600776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:31.601527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:31.602830 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:31.603543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:31.670258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:31.678885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e1d5e13-d694-4375-aa43-7eaa052393b6 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.096286 Jun 29 10:25:31.679456 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1053/2185] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:31 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:31.791499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:31.792224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:31.800340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:31.800943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:31.801701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:31.802135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:31.938997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:31.948142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-003047f2-7314-4480-a3f0-46d9fe00ddaa tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.161224 Jun 29 10:25:31.948716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1133/2186] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:31 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:32.504957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:32.506631 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:32.517144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:32.517881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:32.519261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:32.519835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:32.584802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:32.597928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:32.599594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:32.600726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4d58583-7249-4602-baab-51d9d7e461a0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.102842 Jun 29 10:25:32.601284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1054/2187] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:32 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:32.700485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:32.701491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:32.712411 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:32.713191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:32.714453 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:32.715229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:32.784146 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:32.792876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5cddd670-700b-431e-b137-0a2784dda36b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.098892 Jun 29 10:25:32.793479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1134/2188] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:32 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:32.969291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:32.970470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:32.981539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:32.982282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:32.983618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:32.984347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:33.122430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:33.134311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e6428197-45b7-465a-9881-e8ae5b23b7fc tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.171164 Jun 29 10:25:33.135207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1055/2189] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:32 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:33.629039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:33.629710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:33.637229 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:33.637698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:33.638488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:33.638971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:33.707421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:33.716230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:33.717830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:33.719010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fe0c4adb-3d85-4581-9453-313bc1f401b7 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.096649 Jun 29 10:25:33.719559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1135/2190] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:33 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:33.814754 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:33.815804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:33.826366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:33.827248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:33.828468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:33.829180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:33.892646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:33.901082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f95104a6-638f-413e-a40f-e5797a8e97f2 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093194 Jun 29 10:25:33.901636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1056/2191] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:33 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:34.155749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:34.156683 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:34.164085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:34.164535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:34.165301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:34.165738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:34.301106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:34.313794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-87752d30-5e9b-43a3-9c46-38a7496cde2c tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164143 Jun 29 10:25:34.314832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1136/2192] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:34 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:34.744283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:34.744881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:34.752786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:34.753314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:34.754080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:34.754691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:34.827052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:34.839714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:34.841950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:34.843627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a378c825-6357-45a1-9784-667e7295f02b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.103825 Jun 29 10:25:34.844350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1057/2193] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:34 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:34.926968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:34.928050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:34.939874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:34.940630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:34.941769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:34.942208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:35.008568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:35.016925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f9c4da41-e33e-4715-9ae0-4acfd281453e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.096846 Jun 29 10:25:35.017496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1137/2194] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:34 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:35.340059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:35.340598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:35.347317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:35.347809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:35.349018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:35.349448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:35.352005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:35.509804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:35.518221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-491e941f-1207-4267-a288-594872b68083 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.189070 Jun 29 10:25:35.518834 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1058/2195] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:35 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:35.867541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:35.868511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:35.879241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:35.879790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:35.880548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:35.880982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:35.948498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:35.957513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:35.959049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:35.960198 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df3c685a-3544-416d-9aff-d1dbc16efc7a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099610 Jun 29 10:25:35.960748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1138/2196] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:35 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:25:36.039542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:36.040427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:36.051861 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:36.052378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:36.053160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:36.053592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:36.276842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:36.284855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51bf5897-22bc-4b7a-a96b-adc2dd74edb4 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.252595 Jun 29 10:25:36.285408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1059/2197] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:36 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:36.539267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:36.539947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:36.547190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:36.547718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:36.548564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:36.549047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:36.688300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:36.698393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-66f01055-cbc1-4cb6-aa40-c8542e4ffd7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165307 Jun 29 10:25:36.698975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1139/2198] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:36 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:36.988328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:36.989373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:36.996112 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:36.996564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:36.997321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:36.997753 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:37.063442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:37.072988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:37.074463 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:37.075646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9f681f9f-2acb-4389-9594-4402fad83d3f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093983 Jun 29 10:25:37.076192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1060/2199] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:36 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:37.305144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:37.310888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:37.320851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:37.321360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:37.322127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:37.322584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:37.337383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=100 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:37.384437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:37.392343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-76e5273f-31ce-4ee3-9076-cd80e16939a1 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.094721 Jun 29 10:25:37.392904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1140/2200] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:37 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:37.719752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:37.720763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:37.731139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:37.731889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:37.733172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:37.733907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:37.879120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:37.887467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd874ce9-ada4-4043-af3f-4616bfe360a6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.174300 Jun 29 10:25:37.888028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1061/2201] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:37 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:38.094473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:38.095122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:38.101974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:38.102428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:38.103222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:38.103656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:38.164477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:38.173315 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:38.174875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:38.176011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-970cec4a-277c-4b6d-8ca6-a07192f96cb6 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.085562 Jun 29 10:25:38.176569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1141/2202] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:38 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:38.409642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:38.410252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:38.417171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:38.417626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:38.418401 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:38.418870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:38.482541 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:38.491486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74e9e5da-0971-4e9f-88f5-2b3f72ac8fc0 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085851 Jun 29 10:25:38.492049 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1062/2203] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:38 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:38.905913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:38.906726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:38.916619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:38.917184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:38.918336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:38.918817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:39.058092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:39.066703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-03a20744-dfd5-4851-a0e6-b6663b858cbf tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.165342 Jun 29 10:25:39.067279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1142/2204] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:38 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:39.194786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:39.195432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:39.202252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:39.202733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:39.203487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:39.203913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:39.270623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:39.285011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:39.287465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:39.289128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b2a1bf29-6bbf-4681-a60a-942dfad7019e tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.099080 Jun 29 10:25:39.289687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1063/2205] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:39 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:39.509232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:39.509825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:39.516369 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:39.516833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:39.517626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:39.518072 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:39.580118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:39.597436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-852f8174-3d52-4f3c-9fce-d56723ceab5e tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.085176 Jun 29 10:25:39.597436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1143/2206] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:39 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:40.084169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:40.085047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:40.091965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:40.092444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:40.093185 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:40.093623 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:40.235744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:40.244426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ca0759ae-807d-4d71-a91b-7cf5211a4f66 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.164223 Jun 29 10:25:40.245026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1064/2207] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:40 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:40.311696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:40.312496 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:40.322597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:40.323066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:40.323823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:40.324255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:40.392432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:40.401859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:40.403446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:40.404569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-38a5bbf9-c406-41a1-93ad-f4ed1d7d7c8a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.100063 Jun 29 10:25:40.405137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1144/2208] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:40.611711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:40.612595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] [instance: 1ab146cd-3f99-4717-94ea-5dd164c1f887] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:40.620318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:40.620771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:40.621534 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:40.621973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:40.689951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ed196e5ad6415aa9b7a7c1b3dad277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce73b243663d4ee6b991c9262d1286d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:40.698498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-10589b0d-8104-40c6-99a6-a5f9d34570c7 tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887" status: 200 len: 1387 microversion: 2.1 time: 0.093472 Jun 29 10:25:40.699105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1065/2209] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:40 2022] GET /compute/v2.1/servers/1ab146cd-3f99-4717-94ea-5dd164c1f887 => generated 1387 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:40.718115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-567f1f11-19c7-4ce0-aa4f-1059ce9fb18b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] Calling method '.version_select at 0x7f38703779d0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:40.743199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-567f1f11-19c7-4ce0-aa4f-1059ce9fb18b tempest-TestMinimumBasicScenario-1766605503 tempest-TestMinimumBasicScenario-1766605503-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-260809395" status: 202 len: 0 microversion: 2.1 time: 0.031067 Jun 29 10:25:40.744000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1145/2210] 10.222.0.52 () {58 vars in 1268 bytes} [Wed Jun 29 10:25:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-260809395 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:25:41.261630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:41.262317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: e79b46e7-cd1e-460d-a080-132fa6764043] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:41.268974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:41.269323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:41.270037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:41.270478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:41.405513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:41.414292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81fa606f-83e8-4584-b148-e3de33a99a3b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043" status: 200 len: 1559 microversion: 2.1 time: 0.156551 Jun 29 10:25:41.414929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1066/2211] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:41 2022] GET /compute/v2.1/servers/e79b46e7-cd1e-460d-a080-132fa6764043 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:41.423755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:41.424281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:41.438928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:41.438928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:41.438928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:41.438928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:41.501370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:41.510449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:41.511976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:41.513122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7200697-89f7-4623-8d5f-941fc6dfee71 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.093951 Jun 29 10:25:41.513686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1146/2212] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:41 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:25:42.530652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:42.531282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:42.533885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:42.540747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:42.541197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:42.541972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:42.542399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:42.608826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:42.618133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:42.619683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:42.620825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-34494730-2eb1-41ee-aee8-db220df31d25 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 200 len: 1444 microversion: 2.20 time: 0.094164 Jun 29 10:25:42.621411 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1067/2213] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:42 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:42.639513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-977856f0-9709-4eb0-be2d-f23f6202756a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '.version_select at 0x7f38705f5e50>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:42.660865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-977856f0-9709-4eb0-be2d-f23f6202756a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870743805" status: 204 len: 0 microversion: 2.20 time: 0.025361 Jun 29 10:25:42.661659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1147/2214] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Jun 29 10:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870743805 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 10:25:43.502606 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-67d38d44-fe49-4bc9-9ab0-772972c15779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'create', calling method: .version_select at 0x7f38701a6af0>, body: {"keypair": {"name": "tempest-keypair-264818126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGZsNh6hnhpkx5RKUJR7rcKYROkPw+nlUd0U2LMjl6M7Dv6jI8jzw6LawjVzbtBaMRIKauWsXkqtL6S0vuIEb44+MAJ/vV43xZTO6BKrD40V1Zspl/IQBBfs2dwpWlo3Q=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:25:43.516939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-67d38d44-fe49-4bc9-9ab0-772972c15779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for project f57102c066054370a153fb18dc4bc428. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:25:43.521172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-67d38d44-fe49-4bc9-9ab0-772972c15779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for user 7900ba750c5f4e9faa69baaed1fd95d7 and project f57102c066054370a153fb18dc4bc428. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:25:43.557189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-67d38d44-fe49-4bc9-9ab0-772972c15779 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059280 Jun 29 10:25:43.558903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1068/2215] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Jun 29 10:25:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 10:25:44.798010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:44.799157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:44.807106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:44.807566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:44.808353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:44.808794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:44.837326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:25:44.926054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3c5db2c0-3e97-49b8-a70e-397cffa02fed tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 204 len: 0 microversion: 2.1 time: 0.131947 Jun 29 10:25:44.927522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1148/2216] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:25:44 2022] DELETE /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:25:44.937855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:44.938816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:44.948557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:44.949096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:44.949948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:44.950550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:45.230245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:45.249090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b84a5c71-7e7f-436e-b7f8-bf4dbfe6de4d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.316534 Jun 29 10:25:45.250916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1069/2217] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:45.457475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1892128132", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94e95166-d965-465b-aef9-2a22cc2e6ee9"}], "security_groups": [{"name": "tempest-securitygroup--1031355535"}], "key_name": "tempest-keypair-264818126", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:25:45.582505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] validate_networks() for [('94e95166-d965-465b-aef9-2a22cc2e6ee9', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:25:46.267365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:46.268004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:46.275298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:46.275751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:46.276536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:46.276969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:46.286713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:25:46.288499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:25:46.289332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:25:46.289752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:25:46.290167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:25:46.299460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:46.299903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:46.300671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:46.301316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:46.320889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for project f57102c066054370a153fb18dc4bc428. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:25:46.325115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Getting quotas for user 7900ba750c5f4e9faa69baaed1fd95d7 and project f57102c066054370a153fb18dc4bc428. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:25:46.336701 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:25:46.339329 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:25:46.394695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0d30ca59-431b-4312-b925-6ffb9b522d0a tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.943179 Jun 29 10:25:46.395663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1149/2218] 10.222.0.52 () {62 vars in 1187 bytes} [Wed Jun 29 10:25:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 29 10:25:46.407858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a129315-7b3f-4255-a0f8-fa182472861d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:46.408477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5a129315-7b3f-4255-a0f8-fa182472861d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:46.424099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:46.438500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a4bf50d9-68f3-44ec-8ab5-4b08a16109bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175047 Jun 29 10:25:46.439720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1070/2219] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:46.498735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a129315-7b3f-4255-a0f8-fa182472861d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:46.507513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a129315-7b3f-4255-a0f8-fa182472861d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:46.509144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a129315-7b3f-4255-a0f8-fa182472861d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:46.511052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a129315-7b3f-4255-a0f8-fa182472861d tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1281 microversion: 2.20 time: 0.106946 Jun 29 10:25:46.511816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1150/2220] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:46 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:47.455434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:47.456078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:47.465600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:47.466412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:47.467415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:47.468041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:47.530922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:47.532272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:47.546438 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:47.547236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:47.548868 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:47.549858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:47.635314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:47.644117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4c1d243-1902-4d3c-bbee-4d8c94bcd373 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.192509 Jun 29 10:25:47.644679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1071/2221] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:47.795734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:47.806497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:47.808083 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:47.809449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-86cf9f5f-48ef-43c9-bedf-0b1eb35e2a5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1339 microversion: 2.20 time: 0.284019 Jun 29 10:25:47.810548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1151/2222] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:47 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1339 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:48.662203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:48.662996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:48.669864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:48.670311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:48.671124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:48.671553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:48.806603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:48.815149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81c1a204-2e30-4532-956e-55ca9746961c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.156866 Jun 29 10:25:48.815709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1072/2223] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:48.828657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:48.829272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:48.836208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:48.836654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:48.837407 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:48.837877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:49.184587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:49.193829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:49.195328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:49.196519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-046b0406-ee5a-4296-896a-498425dee452 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.371833 Jun 29 10:25:49.197079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1152/2224] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:48 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:49.833359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:49.834719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:49.852638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:49.853707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:49.854896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:49.855483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:50.117186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-25388d59-3b1e-4291-8ea7-ae51eeb1602f req-db7585d9-297b-4e20-9347-d40a8d57eac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3753af5e-d32e-4c87-a92c-e23d3e049f4d", "tag": "2163f1e7-379e-45a6-9fea-6b67287f21cc"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:25:50.132253 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-25388d59-3b1e-4291-8ea7-ae51eeb1602f req-db7585d9-297b-4e20-9347-d40a8d57eac0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:50.132966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-25388d59-3b1e-4291-8ea7-ae51eeb1602f req-db7585d9-297b-4e20-9347-d40a8d57eac0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:50.149345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-25388d59-3b1e-4291-8ea7-ae51eeb1602f req-db7585d9-297b-4e20-9347-d40a8d57eac0 service nova] Creating event network-changed:2163f1e7-379e-45a6-9fea-6b67287f21cc for instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d on hv-cinder-76810 Jun 29 10:25:50.155417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-25388d59-3b1e-4291-8ea7-ae51eeb1602f req-db7585d9-297b-4e20-9347-d40a8d57eac0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134084 Jun 29 10:25:50.156704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1153/2225] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:25:50.229134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:50.232249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:50.236500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:50.242558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a6813a1-460d-45bb-8bde-362926aa171c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.414270 Jun 29 10:25:50.243586 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1073/2226] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:50.248190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:50.248750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:50.250103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:50.250828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:50.463222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:50.472337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:50.473852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:50.475254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-242ac680-5f9c-4ba5-b68f-18c7e1800aa0 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.265098 Jun 29 10:25:50.475874 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1154/2227] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:50 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:25:51.260095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:51.260697 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:51.267583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:51.268039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:51.268808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:51.269240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:51.434322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:51.443154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fcafc77b-0fcf-40e5-9522-d7a9e480f8dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.187011 Jun 29 10:25:51.443978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1074/2228] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:51.493622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:51.494322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:51.496992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:51.502488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:51.503058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:51.503901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:51.504399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:51.671797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:51.694176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:51.700756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:51.702176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6105f082-5068-4f04-84d9-071c381a7c39 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.212776 Jun 29 10:25:51.702912 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1155/2229] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:51 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:52.464629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:52.465628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:52.476950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:52.477719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:52.479107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:52.479840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:52.617660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:52.620090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=100 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:52.627877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8d63861f-0126-4cc2-820c-209aa37b34e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169933 Jun 29 10:25:52.628484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1075/2230] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:52.727643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:52.728995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:52.741251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:52.741859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:52.742978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:52.743582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:52.886122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:52.894987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:52.896530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:52.898206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a59643b9-d630-493a-8d73-7080f431c6fa tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.179430 Jun 29 10:25:52.898794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1156/2231] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:52 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:53.649585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:53.650503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:53.654073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=4 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:53.663160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:53.663600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:53.664377 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:53.664811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:53.796597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:53.805577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-670a8473-8cc2-423b-b303-0a49f5ea396b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162311 Jun 29 10:25:53.806152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1076/2232] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:53.920756 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:53.921359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:53.928704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:53.929155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:53.929918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:53.930352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:54.065983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:54.074241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:54.075798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:54.076871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8fd32afe-9898-4b53-a3a3-bad5635d6d5b tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.160216 Jun 29 10:25:54.077594 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1157/2233] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:53 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:54.825553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:54.826190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:54.835153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:54.835619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:54.836398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:54.836839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:54.987488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:54.996407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a0ffcba-8f44-44d2-9bd9-a9810f125abd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.176916 Jun 29 10:25:54.996931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1077/2234] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:55.098597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:55.099463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:55.106907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:55.107356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:55.108106 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:55.108552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:55.252500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:55.261322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:55.262841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:55.263940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0ea161d4-bbd3-4e97-815a-5d100937a3e2 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.171763 Jun 29 10:25:55.264506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1158/2235] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:55 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:55.642803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-dde2e274-9c78-4456-be55-c7c93a0c0428 req-9f2a19a1-2dd5-4442-bd28-4a689ad9fe48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3753af5e-d32e-4c87-a92c-e23d3e049f4d", "name": "network-vif-plugged", "status": "completed", "tag": "2163f1e7-379e-45a6-9fea-6b67287f21cc"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:25:55.651927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-dde2e274-9c78-4456-be55-c7c93a0c0428 req-9f2a19a1-2dd5-4442-bd28-4a689ad9fe48 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:55.652363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-dde2e274-9c78-4456-be55-c7c93a0c0428 req-9f2a19a1-2dd5-4442-bd28-4a689ad9fe48 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:55.663858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-dde2e274-9c78-4456-be55-c7c93a0c0428 req-9f2a19a1-2dd5-4442-bd28-4a689ad9fe48 service nova] Creating event network-vif-plugged:2163f1e7-379e-45a6-9fea-6b67287f21cc for instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d on hv-cinder-76810 Jun 29 10:25:55.671348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-dde2e274-9c78-4456-be55-c7c93a0c0428 req-9f2a19a1-2dd5-4442-bd28-4a689ad9fe48 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222216 Jun 29 10:25:55.672171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1078/2236] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:25:56.021537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:56.022551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:56.032894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:56.033531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:56.034839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:56.035573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:56.171279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:56.173505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:56.180784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6396d21d-adde-43ad-b95e-03b58ca7c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165949 Jun 29 10:25:56.181372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1159/2237] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:56.287728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:56.288696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:56.298416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:56.299163 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:56.300320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:56.301002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:56.433398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:56.445780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:56.448160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:56.449917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1fc8765a-8991-4ac4-9dd5-b4a8248d1f6f tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1407 microversion: 2.20 time: 0.169597 Jun 29 10:25:56.450738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1079/2238] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:56 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:57.205597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:57.206921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:57.211240 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:57.211908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=8 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:25:57.218490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:57.219119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:57.219920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:57.220323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:57.372119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:57.380406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d2b30b59-170e-4e69-b6d8-5e498ea184a8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.183684 Jun 29 10:25:57.381056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1160/2239] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:57.470792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:57.471620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:57.480484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:57.481074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:57.482135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:57.482758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:57.640087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:57.650519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:57.652055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:57.653220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ceb6254-9da0-4a8f-b062-7559724cb402 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1599 microversion: 2.20 time: 0.188103 Jun 29 10:25:57.653755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1080/2240] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:25:57 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:25:57.679331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:57.679831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:57.686070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:57.686523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:57.687314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:57.687789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:57.765980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a55f7e8f-380f-4b04-a864-f276539e0710 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092121 Jun 29 10:25:57.766606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1161/2241] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Jun 29 10:25:57 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:25:58.398659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:58.399190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:58.406110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:58.406595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:58.407374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:58.407809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:58.552296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:58.560602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-63c7953d-a63d-41e5-a233-3aabe074f9f0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166768 Jun 29 10:25:58.561166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1081/2242] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:25:58.941771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-5a613224-cd16-4835-b577-cac6c7cf4e93 req-d9fcb427-6726-42e3-a644-403e64ad7b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3753af5e-d32e-4c87-a92c-e23d3e049f4d", "tag": "2163f1e7-379e-45a6-9fea-6b67287f21cc"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:25:58.950201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-5a613224-cd16-4835-b577-cac6c7cf4e93 req-d9fcb427-6726-42e3-a644-403e64ad7b99 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:58.950675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-5a613224-cd16-4835-b577-cac6c7cf4e93 req-d9fcb427-6726-42e3-a644-403e64ad7b99 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:58.961922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-5a613224-cd16-4835-b577-cac6c7cf4e93 req-d9fcb427-6726-42e3-a644-403e64ad7b99 service nova] Creating event network-changed:2163f1e7-379e-45a6-9fea-6b67287f21cc for instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d on hv-cinder-76810 Jun 29 10:25:58.967257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-5a613224-cd16-4835-b577-cac6c7cf4e93 req-d9fcb427-6726-42e3-a644-403e64ad7b99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029938 Jun 29 10:25:58.968272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1162/2243] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:25:59.581172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:25:59.581812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:25:59.592529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:59.593005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:59.594076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:25:59.594740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:25:59.735803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:25:59.744214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6cf8520e-8c3f-4378-86dd-37c6bf8f0270 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169241 Jun 29 10:25:59.744905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1082/2244] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:25:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:00.767339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:00.768502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:00.777071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:00.777551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:00.778312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:00.778808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:00.918892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:00.927392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8e9dde19-61e0-4123-83a0-c5deb0cc4db8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167913 Jun 29 10:26:00.928016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1163/2245] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:01.949140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:01.949907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:01.959047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:01.960371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:01.961387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:01.961967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:02.102515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:02.111271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cfe53eec-136e-489e-9de9-e66e9093daf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167537 Jun 29 10:26:02.111855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1083/2246] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:03.133007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:03.134034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:03.145211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:03.146085 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:03.147374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:03.147820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:03.281575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:03.290130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-228c7763-9b28-439d-91b6-c975f8733e82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163789 Jun 29 10:26:03.290731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1164/2247] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:04.311691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:04.312617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:04.322691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:04.323143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:04.323905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:04.324339 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:04.464951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:04.473278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1d3be5ba-2e03-487e-b32c-f66bf7eab9b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168240 Jun 29 10:26:04.473883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1084/2248] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:05.495044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:05.496033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:05.506950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:05.507406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:05.508170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:05.508619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:05.657452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:05.666279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fbb88820-f168-4554-af0f-f281b2d4c4ea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177931 Jun 29 10:26:05.666892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1165/2249] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:06.689505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:06.690086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:06.697208 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:06.697662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:06.698421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:06.698893 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:06.835213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:06.843797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-99118517-9eef-4d4e-8c76-da8c24d0d824 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158655 Jun 29 10:26:06.844384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1085/2250] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:07.861541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:07.862159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:07.869270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:07.869718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:07.870469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:07.870941 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:08.021503 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:08.033748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7ad57505-39e3-4056-a74a-69716d170753 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175843 Jun 29 10:26:08.034227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1166/2251] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:09.052396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:09.053148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:09.060752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:09.061178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:09.061960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:09.062387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:09.224094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:09.232910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad1d57a3-9d86-42ba-a3bb-10fa654bbb61 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.184516 Jun 29 10:26:09.233458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1086/2252] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:10.249596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:10.250213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:10.257214 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:10.258284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:10.258419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:10.258818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:10.402697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:10.411254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e75acf3-b179-4bdc-9ecd-674c9c80e6db tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165275 Jun 29 10:26:10.411839 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1167/2253] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:11.432838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:11.433488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:11.440973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:11.441421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:11.442181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:11.442654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:11.584656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:11.592731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8fa98f4f-e871-4153-bbab-78b836556a09 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166086 Jun 29 10:26:11.593292 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1087/2254] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:12.613929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:12.614936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:12.622331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:12.622813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:12.623605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:12.624052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:12.769403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:12.777784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a44309dc-e39e-4566-84de-9d5348b8ab06 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170937 Jun 29 10:26:12.778365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1168/2255] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:13.797461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:13.798271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:13.801454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:13.809266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:13.809897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:13.810931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:13.811513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:13.950710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:13.959150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-756a26bb-0c3b-4b60-9710-59cf29b8afad tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166890 Jun 29 10:26:13.959728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1088/2256] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:14.981823 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:14.982821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:14.992811 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:14.993267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:14.994039 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:14.994478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:15.131949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:15.140360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8c8adb83-5a30-4769-b93b-7a10d06fc725 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165234 Jun 29 10:26:15.140915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1169/2257] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:16.162852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:16.163418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:16.171542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:16.172097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:16.172960 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:16.173468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:16.309607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:16.318189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-81fe0d08-145e-4d65-9ce7-3dfab7c72ecc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162542 Jun 29 10:26:16.319154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1089/2258] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:17.337565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:17.338138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:17.345243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:17.345712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:17.346506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:17.346991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:17.487235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:17.498471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2e7f3e66-1f5c-4b82-8650-19df96ad4996 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165983 Jun 29 10:26:17.499250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1170/2259] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:18.521722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:18.522748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:18.533751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:18.534501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:18.535808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:18.536543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:18.674314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:18.685593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ff2cf76e-53db-4a06-b13c-b965f7458add tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170377 Jun 29 10:26:18.686316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1090/2260] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:19.711428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:19.712077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:19.719319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:19.719789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:19.720540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:19.720976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:19.858959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:19.867564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-022d88e7-30bd-4ba8-8c76-4c876683f0e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161895 Jun 29 10:26:19.868103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1171/2261] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:20.889043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:20.890053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:20.899671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:20.900126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:20.901165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:20.901603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:21.035744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:21.046394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9593c903-4124-49c4-9d35-9c6207e71c44 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163625 Jun 29 10:26:21.047304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1091/2262] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:22.069017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:22.070200 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:22.072707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=34 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:22.078285 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:22.078771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:22.079535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:22.079967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:22.215061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:22.228117 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-66831bcd-63ad-4731-be5b-b8c5685b1a64 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166210 Jun 29 10:26:22.228699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1172/2263] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:23.246666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:23.247262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:23.254993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:23.255437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:23.256186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:23.256643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:23.259650 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=94 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:23.391067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:23.402544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-838583cd-0ad5-4239-af49-fc6b52fec280 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160141 Jun 29 10:26:23.403147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1092/2264] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:24.422932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:24.423808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:24.434100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:24.434921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:24.436178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:24.436908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:24.576553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:24.584689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-33918dfc-40e9-4c32-b573-32ddfdb66352 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168801 Jun 29 10:26:24.585230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1173/2265] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:25.606501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:25.607530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:25.618257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:25.618741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:25.619504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:25.619932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:25.766821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:25.775738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-404a7f90-09d8-4deb-be90-02799db76162 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175813 Jun 29 10:26:25.776308 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1093/2266] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:26.796479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:26.797208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:26.807012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:26.807466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:26.808243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:26.808680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:26.950846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:26.959261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-54edb7ba-02ba-4c94-8dfb-0d3a285829fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168589 Jun 29 10:26:26.959841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1174/2267] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:27.979571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:27.980284 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:27.988719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:27.989280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:27.990225 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:27.990850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:28.128443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:28.136985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77ec1291-b629-4450-922f-279464af64b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163310 Jun 29 10:26:28.137561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1094/2268] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:29.158521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:29.159521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:29.172150 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:29.172888 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:29.174131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:29.174901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:29.179654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=86 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:29.311494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:29.320002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6858c81c-9128-4855-bb20-257a8ff3a7e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167938 Jun 29 10:26:29.320713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1175/2269] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:30.341172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:30.342003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:30.352281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:30.352730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:30.353507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:30.353936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:30.499705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:30.508451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dab171f6-7355-4a5d-8431-bd0e756b8283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.173374 Jun 29 10:26:30.509267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1095/2270] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:31.528153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:31.528807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:31.536895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:31.537346 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:31.538110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:31.538546 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:31.680627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:31.689317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2bad5f55-b529-4236-8b9d-14aa96f4c169 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167653 Jun 29 10:26:31.689892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1176/2271] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:32.711615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:32.712629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:32.724357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:32.725150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:32.726551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:32.727226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:32.860579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:32.868860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6bb6793d-3e2f-41fe-a35c-c959af3d6bd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164066 Jun 29 10:26:32.869625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1096/2272] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:32.871447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:32.871954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:32.878781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:32.879249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:32.880071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:32.880497 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:32.904274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1787e102-8e82-46f9-b31c-02a2eb522226 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d/ips" status: 200 len: 152 microversion: 2.20 time: 0.036925 Jun 29 10:26:32.904830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1177/2273] 10.222.0.52 () {60 vars in 1288 bytes} [Wed Jun 29 10:26:32 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 10:26:33.886769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:33.887448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:33.894450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:33.894963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:33.895792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:33.896251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:34.037547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:34.046706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9cbfe16e-97d2-4edb-9894-461c5c02d60b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164268 Jun 29 10:26:34.047235 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1097/2274] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:35.066215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:35.066853 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:35.074525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:35.074998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:35.075746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:35.076176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:35.222215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:35.230948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a9259893-c6d8-4c93-b75a-7a00aaed1cc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168915 Jun 29 10:26:35.231517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1178/2275] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:36.251038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:36.252089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:36.261804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:36.262252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:36.263066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:36.263499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:36.402611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:36.410717 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c489aca4-ceba-4ca4-911f-3e7dd3b73832 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166111 Jun 29 10:26:36.411280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1098/2276] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:37.432159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:37.432781 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:37.440343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:37.440820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:37.441616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:37.442069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:37.572821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:37.581366 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ce8ec365-2cb1-4459-b2bf-6d132d7fd82c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.155297 Jun 29 10:26:37.581940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1179/2277] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:38.602994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:38.603869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:38.612083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:38.612619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:38.613520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:38.614035 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:38.750883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:38.759088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d982e3b2-c4b4-4548-a888-ecaf0a3ef55c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162534 Jun 29 10:26:38.759660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1099/2278] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:39.776016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:39.776618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:39.783665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:39.784118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:39.784889 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:39.785331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:39.924136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:39.936681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4ac7332-bea8-4017-b65b-e2093e181d82 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164522 Jun 29 10:26:39.937476 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1180/2279] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:40.958847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:40.959875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:40.971378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:40.972134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:40.973489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:40.974218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:41.123175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:41.131648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dbeb2d04-8911-46ee-a86d-87a754ec4679 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179427 Jun 29 10:26:41.132222 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1100/2280] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:42.155760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:42.156745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:42.167822 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:42.168275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:42.169033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:42.169461 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:42.307038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:42.315622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d6aff00a-7594-48a1-8235-bc81ee10d1d9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169081 Jun 29 10:26:42.316100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1181/2281] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:43.340434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:43.341101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:43.349040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:43.349566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:43.350449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:43.350990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:43.484778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:43.493079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cdbb57a0-5fe6-4396-82df-6519286bfd50 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159912 Jun 29 10:26:43.493625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1101/2282] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:44.513804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:44.514532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:44.523027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:44.523586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:44.524528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:44.525068 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:44.659144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:44.667227 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-58789bcf-2a41-4745-a3f3-0c557768750e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159661 Jun 29 10:26:44.667795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1182/2283] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:45.687763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:45.688963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:45.691972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=28 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:45.699188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:45.699899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:45.700936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:45.701400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:45.841210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:45.853681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f6ddc23-0020-4b60-a79b-b6cfd42fdbf3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171393 Jun 29 10:26:45.854430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1102/2284] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:46.876322 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:46.877307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:46.888728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:46.889167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:46.889923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:46.890362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:47.030447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:47.038514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b5182a34-7155-4aad-8aff-1c21a2720065 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169482 Jun 29 10:26:47.039141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1183/2285] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:48.060164 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:48.060582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:48.067745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:48.068194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:48.068951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:48.069380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:48.201171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:48.209840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d6d2c419-65e5-408b-8ff7-218f244a42be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.156488 Jun 29 10:26:48.210384 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1103/2286] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:49.237542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:49.238672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:49.248568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:49.249018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:49.249769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:49.250196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:49.382421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:49.390495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6a014c9b-cab5-4a95-a64e-fe70532041fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160247 Jun 29 10:26:49.391103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1184/2287] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:50.412824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:50.413729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:50.422918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:50.423375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:50.424140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:50.424573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:50.567757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:50.575926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e18f823b-229b-43fc-bbd6-33cbc979e4df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170061 Jun 29 10:26:50.576501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1104/2288] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:51.594896 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:51.595639 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:51.604168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:51.604730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:51.605680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:51.606431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:51.744817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:51.753265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f596fbf2-967e-457e-8e42-adf498dff587 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163570 Jun 29 10:26:51.753837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1185/2289] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:52.775107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:52.776607 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:52.788933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:52.789723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:52.791031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:52.791763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:52.932836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:52.942221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5206d7be-a04c-44cd-a720-9458297a52d4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174368 Jun 29 10:26:52.942807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1105/2290] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:53.961341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:53.962129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:53.964956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=28 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:53.971961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:53.972408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:53.973163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:53.973587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:54.118937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:54.129381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-597e0f2d-10be-4488-af57-7398261a3ea4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172886 Jun 29 10:26:54.130114 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1186/2291] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:55.153751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:55.154859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:55.165805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:55.166610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:55.167882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:55.168744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:55.171340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=84 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:26:55.302510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:55.311902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1795ff3b-d665-440a-bd9a-87b052e5a748 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164794 Jun 29 10:26:55.312178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1106/2292] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:56.339274 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:56.340219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:56.351442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:56.352189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:56.353458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:56.354181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:56.500452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:56.508537 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-62ecd3c5-6828-480b-a166-6fbc15a2c2e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175822 Jun 29 10:26:56.509109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1187/2293] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:57.529889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:57.530796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:57.539190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:57.539767 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:57.540711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:57.541252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:57.686106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:57.694531 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5a6b9c98-548d-48f8-be80-30c13cad0963 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170876 Jun 29 10:26:57.695130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1107/2294] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:57.839025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:26:57.839218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:26:58.716472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:58.717512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:58.728492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:58.729246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:58.730509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:58.731262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:58.869616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:26:58.878359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-53cc90d8-7bce-4d05-940b-3d65b55e5e65 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168493 Jun 29 10:26:58.878983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1188/2295] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:26:59.900170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:26:59.901195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:26:59.908950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:59.909385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:26:59.910176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:26:59.910620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:00.056856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:00.065517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c8287239-43ec-42e2-b49b-0a0aa15ee38b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172179 Jun 29 10:27:00.066015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1108/2296] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:26:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:01.086733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:01.087350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:01.094276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:01.094765 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:01.095538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:01.095973 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:01.098494 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=82 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:01.238273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:01.249342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-443b6428-c33a-46b3-8c0c-49661b015b85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166552 Jun 29 10:27:01.249890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1189/2297] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:02.271067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:02.272010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:02.281805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:02.282256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:02.283058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:02.283497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:02.420957 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:02.429085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-97e7f4dc-c7e5-42b4-8a12-e35efd121c47 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164907 Jun 29 10:27:02.429639 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1109/2298] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:03.455225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:03.455871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:03.465282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:03.465875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:03.466804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:03.467241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:03.614037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:03.623415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a500b79d-8544-4b19-a6e8-48390e1b2f8d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.173946 Jun 29 10:27:03.623990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1190/2299] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:04.645054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:04.646025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:04.657085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:04.657829 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:04.659129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:04.659842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:04.801019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:04.813797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-85c313ad-50db-45c5-9428-af410077db1d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174665 Jun 29 10:27:04.814519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1110/2300] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:05.839133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:05.840131 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:05.848067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:05.848517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:05.849272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:05.849705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:05.991750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:06.000397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-632df1c0-eba7-4fb8-8174-23cba7b312f8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167675 Jun 29 10:27:06.000962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1191/2301] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:07.021404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:07.022410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:07.033742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:07.034497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:07.035819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:07.036544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:07.183218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:07.193258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-902223cb-dd7d-45de-a3c4-ad2fe877812f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.178354 Jun 29 10:27:07.193823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1111/2302] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:08.214892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:08.215518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:08.222753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:08.223192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:08.223959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:08.224396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:08.374424 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:08.389261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5bfbcbf8-aa74-487d-9f43-8e51b4a1bdd3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179798 Jun 29 10:27:08.389968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1192/2303] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:09.410991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:09.411945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:09.423243 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:09.424106 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:09.425248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:09.426467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:09.584634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:09.593654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9c942865-d17a-43e4-9300-2eb159e8c1ba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.188936 Jun 29 10:27:09.593876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1112/2304] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:10.616070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:10.617321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:10.628501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:10.629256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:10.630521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:10.631296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:10.772278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:10.780737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-48871aba-a605-4dcd-81f4-47ba6b65d2f4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171247 Jun 29 10:27:10.781382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1193/2305] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:11.802056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:11.803079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:11.814166 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:11.814622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:11.815405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:11.815842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:11.953952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:11.962098 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-83af9d87-4504-487c-a4c0-82402beb94ff tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166889 Jun 29 10:27:11.962656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1113/2306] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:12.985252 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:12.985981 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:12.994081 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:12.994598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:12.995526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:12.996030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:13.147143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:13.158828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63ea02ae-33b8-41b9-ac38-60c587529632 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.180840 Jun 29 10:27:13.159406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1194/2307] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:14.177128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:14.177848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:14.186547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:14.187158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:14.188527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:14.188967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:14.324422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:14.333242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3309714d-3df6-440c-8ada-e7a2846f8239 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161376 Jun 29 10:27:14.333828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1114/2308] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:15.354686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:15.355581 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:15.367178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:15.367927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:15.369185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:15.369919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:15.526296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:15.534755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a2561a8-70ec-4e3b-8bfc-7f25315db123 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.186750 Jun 29 10:27:15.535335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1195/2309] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:16.556432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:16.557399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:16.561137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:16.571147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:16.571904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:16.573168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:16.573895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:16.705479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:16.714026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7576c2c2-4d42-4795-bcac-dfc24d53445d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164256 Jun 29 10:27:16.714608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1115/2310] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:17.735705 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:17.736655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:17.750247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:17.751042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:17.752284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:17.753004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:17.890066 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:17.900882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e1df2216-8509-44af-b4f3-85b52d1097f6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171348 Jun 29 10:27:17.901760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1196/2311] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:18.927656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:18.928291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:18.935223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:18.935677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:18.936443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:18.936884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:19.075348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:19.083817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc005ce6-d133-47aa-ab48-15ca30220f11 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161395 Jun 29 10:27:19.084394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1116/2312] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:20.101568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:20.102089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:20.109069 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:20.109527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:20.110281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:20.110758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:20.245385 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:20.254469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5b8bce2b-8240-47ab-9677-3eb14b3cba2c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157032 Jun 29 10:27:20.255088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1197/2313] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:21.272078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:21.272709 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:21.279689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:21.280139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:21.280903 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:21.281340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:21.416597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:21.425197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-77b36a67-7c68-4816-82b5-68491271de2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157251 Jun 29 10:27:21.425890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1117/2314] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:22.446903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:22.447695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:22.456671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:22.457261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:22.458281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:22.459254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:22.596457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:22.604893 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ab798207-9631-4030-8026-bcd3176196c8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164131 Jun 29 10:27:22.605440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1198/2315] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:23.630029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:23.631132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:23.642410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:23.643210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:23.644470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:23.645203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:23.788287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:23.801258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b6d33e5-2801-4d0c-8688-2cc13b5053e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177603 Jun 29 10:27:23.801951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1118/2316] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:24.823101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:24.824102 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:24.827395 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:24.836210 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:24.836650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:24.837409 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:24.837842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:24.984153 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:24.997073 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-42ccfca9-28b7-4606-bdc7-0811625c703c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.180173 Jun 29 10:27:24.997951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1199/2317] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:26.020582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:26.021317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:26.029968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:26.030507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:26.031435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:26.031945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:26.034938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:26.172240 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:26.180936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-595b9c68-fc5f-4820-b5fe-2ae7f3520e83 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165134 Jun 29 10:27:26.181720 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1119/2318] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:27.207824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:27.208878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:27.220430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:27.221121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:27.222361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:27.223121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:27.364327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:27.377236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a0d90a55-0e4a-48cb-ab0e-65c72737c04f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175709 Jun 29 10:27:27.378021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1200/2319] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:28.395434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:28.396158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:28.402599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:28.403079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:28.403848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:28.404298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:28.543617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:28.552322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f59e3c23-ccee-48a8-bd8d-cd5f9ef397a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161333 Jun 29 10:27:28.552887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1120/2320] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:29.573384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:29.574036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:29.581448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:29.581924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:29.582836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:29.583296 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:29.714554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:29.726972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-707010d5-7285-4d15-a632-92c14d167e4b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159332 Jun 29 10:27:29.727803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1201/2321] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:30.748625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:30.749596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:30.760998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:30.761757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:30.763089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:30.763824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:30.905147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:30.917054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-918a73b5-7fda-446d-bb18-de748594d775 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175531 Jun 29 10:27:30.917645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1121/2322] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:31.942445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:31.943448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:31.951826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:31.952275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:31.953033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:31.953467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:31.956030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:32.101208 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:32.113250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4093007e-ca12-4497-b166-3b993e12a289 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177566 Jun 29 10:27:32.114027 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1202/2323] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:32.987157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:32.988143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:32.997556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:32.998007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:32.998813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:32.999249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:33.024987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:27:33.104654 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2fef2d59-030d-4b10-9239-5a7628bcf33c tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 204 len: 0 microversion: 2.20 time: 0.123744 Jun 29 10:27:33.105414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1122/2324] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 10:27:32 2022] DELETE /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 10:27:33.113847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:33.114477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:33.121499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:33.121951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:33.122751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:33.123180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:33.130913 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:33.131617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:33.138356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:33.138822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:33.139585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:33.140020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:33.255530 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:33.263830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:33.265316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:33.266469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5d15f218-8f57-456f-96d5-9c777da2d622 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1724 microversion: 2.20 time: 0.156655 Jun 29 10:27:33.267076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1203/2325] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:27:33 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:27:33.272349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:33.282521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a7ab64d7-f836-4da6-b0d7-736fda0afda4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.155729 Jun 29 10:27:33.283338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1123/2326] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:34.289905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:34.290915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:34.301067 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:34.301716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:34.302010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:34.302840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:34.303055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:34.303448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:34.311202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:34.311653 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:34.312824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:34.313260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:34.455087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:34.463211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:34.464516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd7d10cc-0609-4dbd-b048-af6b0bfd312a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167032 Jun 29 10:27:34.473892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1124/2327] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:34.480667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:34.482249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:34.483498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e1f75187-102b-483f-8e7a-53917c325926 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1724 microversion: 2.20 time: 0.201034 Jun 29 10:27:34.484060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1204/2328] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:27:34 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 10:27:35.328742 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-b8d378d0-d27d-4184-8c17-12e8994d9f8e req-15ea1d7c-323d-47b6-8548-ccf4a22d0a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3753af5e-d32e-4c87-a92c-e23d3e049f4d", "name": "network-vif-deleted", "tag": "2163f1e7-379e-45a6-9fea-6b67287f21cc"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:27:35.337797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-b8d378d0-d27d-4184-8c17-12e8994d9f8e req-15ea1d7c-323d-47b6-8548-ccf4a22d0a3f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:35.338242 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-b8d378d0-d27d-4184-8c17-12e8994d9f8e req-15ea1d7c-323d-47b6-8548-ccf4a22d0a3f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:35.351575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-b8d378d0-d27d-4184-8c17-12e8994d9f8e req-15ea1d7c-323d-47b6-8548-ccf4a22d0a3f service nova] Creating event network-vif-deleted:2163f1e7-379e-45a6-9fea-6b67287f21cc for instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d on hv-cinder-76810 Jun 29 10:27:35.359014 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-b8d378d0-d27d-4184-8c17-12e8994d9f8e req-15ea1d7c-323d-47b6-8548-ccf4a22d0a3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033932 Jun 29 10:27:35.359634 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1125/2329] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:27:35.482913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:35.483826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:35.490603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:35.491038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:35.491806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:35.492237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:35.501853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:35.503003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:35.510375 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:35.511349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:35.512418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:35.513073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:35.549480 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:35.550315 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:35.551073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lazy-loading 'fault' on Instance uuid 3753af5e-d32e-4c87-a92c-e23d3e049f4d {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:27:35.599123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:35.607569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:35.609199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7900ba750c5f4e9faa69baaed1fd95d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f57102c066054370a153fb18dc4bc428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:35.610374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4155bae0-4a63-4a93-bb4f-98bd05cac309 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 200 len: 1371 microversion: 2.20 time: 0.112724 Jun 29 10:27:35.610977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1126/2330] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:27:35 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 10:27:35.638015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:35.646658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fd7df96e-8713-475f-8487-8bfca5396ffb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169104 Jun 29 10:27:35.647243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1205/2331] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:36.633261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:36.634138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:36.645326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:36.646083 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:36.647406 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:36.648137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:36.663769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] HTTP exception thrown: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:36.664129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:36.664738 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Request method failure captured: Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d HTTP/1.1 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJJ6OxEq8vkrBd62dLFugOsczzcQNGB1vaOqH65Y21E6RFoQqxfOgeYuOcYxmPDkTmruSTeJelVJIdNSDXenjLphTQIK9qPX9H9wg7zjn5AJgTtvSitkkXmgrick7kiXKl-c6Eoy9l09zYsu1sP-4_Cof5-e_LsSdTsNwQQV3HJ_iA Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:27:36.665427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f57102c066054370a153fb18dc4bc428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f57102c066054370a153fb18dc4bc428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 7900ba750c5f4e9faa69baaed1fd95d7 Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:36.667543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '3753af5e-d32e-4c87-a92c-e23d3e049f4d'} Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:27:36.668751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:36.670430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:36.672137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Returning 404 to user: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:27:36.672137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-740c25e8-ca48-4cd1-a8ff-0cbb28940f19 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 404 len: 111 microversion: 2.20 time: 0.040480 Jun 29 10:27:36.672137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1127/2332] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:27:36 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:27:36.672412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:36.672412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:36.673049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:36.673477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:36.675725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-74d290d1-a6db-4518-8a97-6db95036f5ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '.version_select at 0x7f3870407e50>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:36.695159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-74d290d1-a6db-4518-8a97-6db95036f5ee tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264818126" status: 204 len: 0 microversion: 2.20 time: 0.022929 Jun 29 10:27:36.695733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1128/2333] 10.222.0.52 () {60 vars in 1258 bytes} [Wed Jun 29 10:27:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264818126 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 10:27:36.876510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:36.885393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5f590caa-412b-45f9-8522-6804c3b2dae8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.224957 Jun 29 10:27:36.885949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1206/2334] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:37.400802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:37.401368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:37.407560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:37.408008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:37.408772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:37.409211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:37.423020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] HTTP exception thrown: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Request method failure captured: Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d HTTP/1.1 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJJ6OxEq8vkrBd62dLFugOsczzcQNGB1vaOqH65Y21E6RFoQqxfOgeYuOcYxmPDkTmruSTeJelVJIdNSDXenjLphTQIK9qPX9H9wg7zjn5AJgTtvSitkkXmgrick7kiXKl-c6Eoy9l09zYsu1sP-4_Cof5-e_LsSdTsNwQQV3HJ_iA Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:27:37.424585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f57102c066054370a153fb18dc4bc428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f57102c066054370a153fb18dc4bc428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 7900ba750c5f4e9faa69baaed1fd95d7 Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.426326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '3753af5e-d32e-4c87-a92c-e23d3e049f4d'} Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:27:37.430263 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.431942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.433863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Returning 404 to user: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:27:37.433863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6a212f29-e195-410b-a7b2-23aec8f71b73 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 404 len: 111 microversion: 2.20 time: 0.029260 Jun 29 10:27:37.433863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1129/2335] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 10:27:37 2022] DELETE /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:27:37.434994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:37.435610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 3753af5e-d32e-4c87-a92c-e23d3e049f4d] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:37.442165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:37.442665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:37.443430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:37.443871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:37.458063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] HTTP exception thrown: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Request method failure captured: Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d HTTP/1.1 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJJ6OxEq8vkrBd62dLFugOsczzcQNGB1vaOqH65Y21E6RFoQqxfOgeYuOcYxmPDkTmruSTeJelVJIdNSDXenjLphTQIK9qPX9H9wg7zjn5AJgTtvSitkkXmgrick7kiXKl-c6Eoy9l09zYsu1sP-4_Cof5-e_LsSdTsNwQQV3HJ_iA Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:27:37.459763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f57102c066054370a153fb18dc4bc428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f57102c066054370a153fb18dc4bc428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 7900ba750c5f4e9faa69baaed1fd95d7 Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.461548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '3753af5e-d32e-4c87-a92c-e23d3e049f4d'} Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:27:37.462521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. Jun 29 10:27:37.464360 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:37.465826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Returning 404 to user: Instance 3753af5e-d32e-4c87-a92c-e23d3e049f4d could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:27:37.465826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cb3436f9-b121-4774-b8c9-98efcfba5c38 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d" status: 404 len: 111 microversion: 2.20 time: 0.030459 Jun 29 10:27:37.465826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1207/2336] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:27:37 2022] GET /compute/v2.1/servers/3753af5e-d32e-4c87-a92c-e23d3e049f4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:27:37.902751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:37.903333 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:37.910251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:37.910744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:37.911527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:37.911953 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:38.056055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:38.065081 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c026f243-5dfb-45e9-bdd2-6929c5badb36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166334 Jun 29 10:27:38.065625 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1130/2337] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:39.084323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:39.085258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:39.093270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:39.093721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:39.094478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:39.094949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:39.235196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:39.247806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fb50a05e-f0b5-4f60-8d2d-bd8e86a46ca8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169163 Jun 29 10:27:39.248635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1208/2338] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:40.266258 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:40.268289 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:40.276609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:40.277651 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:40.278840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:40.279560 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:40.455170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:40.463357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0dd021fa-fb52-42dc-970e-411930341dba tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.201954 Jun 29 10:27:40.464084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1131/2339] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:41.482955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:41.484018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:41.491632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:41.492080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:41.492858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:41.493287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:41.623640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:41.632094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-570076bf-9330-4f8e-8fec-2de1df092648 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.154396 Jun 29 10:27:41.632657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1209/2340] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:42.654296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:42.654951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:42.661693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:42.662148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:42.662927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:42.663366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:42.802822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:42.812195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-071dc4d4-31ea-4157-b924-a4a6ebfccf13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163910 Jun 29 10:27:42.813137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1132/2341] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:43.833972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:43.835007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:43.846539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:43.847342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:43.848636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:43.849418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:43.989414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:43.999703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a23963dc-5e1d-4b42-9103-765871b9945e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172217 Jun 29 10:27:44.000249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1210/2342] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:44.876178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:44.877264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:44.885471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:44.885907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:44.886724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:44.887223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:44.903378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 HTTP/1.1 Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:27:44.904944 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.906543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '8b391700-0ca4-43cf-8beb-697c52208176'} Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:27:44.907510 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.909188 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.911048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:27:44.911048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4636f089-8b54-49ef-b97d-dc7ed18ff307 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 404 len: 111 microversion: 2.1 time: 0.034070 Jun 29 10:27:44.911048 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1133/2343] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:27:44 2022] DELETE /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:27:44.916381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:44.917195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 8b391700-0ca4-43cf-8beb-697c52208176] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:44.923976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:44.924428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:44.925191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:44.925628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:44.939936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 HTTP/1.1 Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:27:44.941463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.943289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '8b391700-0ca4-43cf-8beb-697c52208176'} Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:27:44.944259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. Jun 29 10:27:44.945633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:27:44.946972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 8b391700-0ca4-43cf-8beb-697c52208176 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:27:44.946972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ca533f81-edb6-479f-9de8-57d0ae009888 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176" status: 404 len: 111 microversion: 2.1 time: 0.030336 Jun 29 10:27:44.946972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1211/2344] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:44 2022] GET /compute/v2.1/servers/8b391700-0ca4-43cf-8beb-697c52208176 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:27:45.021759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:45.022638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:45.031026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:45.031470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:45.032505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:45.032935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:45.177994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:45.186602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-73115c25-bde1-4e81-8b2f-b869c4366331 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171735 Jun 29 10:27:45.187194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1134/2345] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:46.209034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:46.209962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:46.219604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:46.220050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:46.220810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:46.221241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:46.360690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:46.372898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8f4e900d-c944-4fd8-adf0-5b4ac1e4e8fd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171010 Jun 29 10:27:46.373419 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1212/2346] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:47.394930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:47.395771 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:47.399841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:47.409855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:47.410620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:47.411937 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:47.412630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:47.554995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:47.567605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c1b943e5-798f-45c6-9b63-c00201d56f3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179098 Jun 29 10:27:47.568394 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1135/2347] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:48.590516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:48.591134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:48.598427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:48.598901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:48.599657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:48.600090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:48.742957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:48.753071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ecb435dc-a3bf-4b0a-a9d4-c0b7dd5bae17 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168545 Jun 29 10:27:48.753903 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1213/2348] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:49.779809 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:49.780734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:49.791794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:49.792536 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:49.793801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:49.794333 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:49.928976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:49.937602 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9892bbfc-fe94-478c-970c-102b00c1d597 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164240 Jun 29 10:27:49.938119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1136/2349] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:50.959011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:50.960020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:50.969937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:50.970394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:50.971192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:50.971624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:51.102130 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:51.112587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b6425681-e06f-4720-967d-8eb09a9d3ece tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160416 Jun 29 10:27:51.113165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1214/2350] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:52.134038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:52.134924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:52.143827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:52.144277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:52.145030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:52.145458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:52.160609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:52.296788 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:52.307909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5b29089f-5315-4215-995b-3da2e78f0f0d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.180197 Jun 29 10:27:52.308518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1137/2351] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:53.330301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:53.330914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:53.338016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:53.338672 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:53.339587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:53.340050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:53.475922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:53.485442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-64bfebb5-6c55-4e0c-86aa-79c8e500aa36 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160585 Jun 29 10:27:53.486016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1215/2352] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:54.509224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:54.510029 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:54.518498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:54.519105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:54.520053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:54.520595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:54.663001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:54.671545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7592e21a-fa3e-4710-9dbf-e6c7a40bc99a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167141 Jun 29 10:27:54.672260 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1138/2353] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:55.692299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:55.693183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:55.696425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=34 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:27:55.702548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:55.703180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:55.703931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:55.704367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:55.852330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:55.862972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-22cc32e6-e331-47f8-8947-38abd4cf2566 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177292 Jun 29 10:27:55.863529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1216/2354] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:56.885294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:56.885931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:56.893852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:56.894307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:56.895101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:56.895535 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:57.035621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:57.044276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1b1c3b35-18e2-48ff-b6c5-9aedbebca740 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163010 Jun 29 10:27:57.053811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1139/2355] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:58.063080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:58.063983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:58.072135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:58.072663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:58.073551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:58.074062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:58.214551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:58.223128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3624f0ff-d709-41bf-aa66-96938101fdfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165196 Jun 29 10:27:58.223702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1217/2356] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:27:59.245283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:27:59.246269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:27:59.254483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:59.254972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:59.255731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:27:59.256165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:27:59.391609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:27:59.399999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4bc605ca-50b7-4ac2-a7f6-2d60a23a31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161689 Jun 29 10:27:59.400571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1140/2357] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:27:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:00.422013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:00.423267 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:00.438180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:00.438625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:00.439436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:00.439870 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:00.635784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:00.649882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ffc874f2-30f3-4df0-b277-0ebdc9b2c909 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.234314 Jun 29 10:28:00.650596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1218/2358] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:01.676647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:01.677615 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:01.689220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:01.689967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:01.691298 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:01.692020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:01.855516 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:01.864004 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2f2266a8-49cc-44ac-bc60-130037cdd433 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.194160 Jun 29 10:28:01.864571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1141/2359] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:02.885441 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:02.886383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:02.897686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:02.898436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:02.899755 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:02.900495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:02.904698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=94 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:03.036429 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:03.046862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df62bfa9-129e-42f2-b0eb-ed18627e19bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167850 Jun 29 10:28:03.047921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1219/2360] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:04.067337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:04.068264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:04.077769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:04.078245 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:04.079070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:04.079506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:04.223756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:04.231821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cc7db253-35b0-4114-880d-5702a08a829c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170633 Jun 29 10:28:04.232385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1142/2361] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:05.249711 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:05.250325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:05.257158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:05.257618 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:05.258374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:05.258855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:05.395637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:05.404141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6534d651-4778-41b9-aa47-5e034eda3926 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158937 Jun 29 10:28:05.404697 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1220/2362] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:06.425427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:06.426430 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:06.438868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:06.439320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:06.440135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:06.440561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:06.572330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:06.584687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6d91cdee-cb76-4175-9765-f633ab8796fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165591 Jun 29 10:28:06.585429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1143/2363] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:07.609239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:07.610004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:07.618486 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:07.619120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:07.620107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:07.620681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:07.760156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:07.769051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c684fb34-b763-42f9-8c1f-6005735fc9fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166542 Jun 29 10:28:07.769626 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1221/2364] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:08.786830 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:08.787483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:08.796822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:08.797548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:08.798330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:08.798796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:08.951039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:08.961123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7dd3ce17-55f5-4d3b-8ffa-0baa5a444aa3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.178258 Jun 29 10:28:08.961741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1144/2365] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:09.983719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:09.984699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:09.991952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:09.992408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:09.993201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:09.993638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:10.139736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:10.148255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5260ff53-bb6f-460e-bf7f-04e029ddb1b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171202 Jun 29 10:28:10.148804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1222/2366] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:11.169410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:11.170419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:11.182175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:11.182986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:11.184233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:11.184954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:11.323569 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:11.332224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a484a7f7-a2da-4754-9ef7-c8599b8716df tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169377 Jun 29 10:28:11.332784 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1145/2367] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:12.353363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:12.354358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:12.363297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:12.363752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:12.364521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:12.364958 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:12.501587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:12.509714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3fd79f04-5de0-4350-aebc-159865eaf3ca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162870 Jun 29 10:28:12.510290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1223/2368] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:13.531151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:13.532381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:13.543452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:13.544202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:13.545476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:13.546195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:13.684922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:13.694233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd7bf4b6-d03c-489c-a19c-d2ce4fb167a6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169555 Jun 29 10:28:13.694776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1146/2369] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:14.719918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:14.721228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:14.728181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:14.728628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:14.729387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:14.729815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:14.879685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:14.887994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2fef11cf-28fb-49c1-802f-dfdf754a3d72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174675 Jun 29 10:28:14.888533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1224/2370] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:15.908554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:15.909171 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:15.919453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:15.920007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:15.920962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:15.921227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:16.072129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:16.080611 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-859726e3-00cc-4df0-884c-e811ea2741d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.178193 Jun 29 10:28:16.081196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1147/2371] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:17.099094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:17.099921 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:17.108966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:17.109582 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:17.110604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:17.111232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:17.251024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:17.263119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ec8e59bc-11c9-4661-8d90-0098c4ef3d89 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168466 Jun 29 10:28:17.263908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1225/2372] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:18.285118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:18.286126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:18.289842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:18.298820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:18.299227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:18.300002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:18.300437 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:18.443565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:18.456068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-49b7eb5e-f98d-4637-b15f-57ba2190a815 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177516 Jun 29 10:28:18.456986 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1148/2373] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:19.479969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:19.480551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:19.487878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:19.488327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:19.489076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:19.489506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:19.627056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:19.639477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-99c101b2-84f7-41a7-b50b-1c75670e2800 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163163 Jun 29 10:28:19.640273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1226/2374] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:20.660716 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:20.661512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:20.670483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:20.671142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:20.672147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:20.672726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:20.817561 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:20.830444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4bfadf0f-4077-453d-ae06-e22f77677315 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175054 Jun 29 10:28:20.831259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1149/2375] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:21.857807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:21.858775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:21.866416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:21.866899 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:21.867710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:21.868077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:22.012037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:22.020480 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ef3e5731-3508-44bb-8819-d2f313862da1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169348 Jun 29 10:28:22.021058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1227/2376] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:23.042125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:23.043121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:23.055762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:23.056517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:23.057792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:23.058479 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:23.063381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=76 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:23.193722 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:23.202257 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fd946515-756c-4e28-985f-361818f6401f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166817 Jun 29 10:28:23.202849 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1150/2377] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:24.221907 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:24.222684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:24.230470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:24.231053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:24.231988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:24.232517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:24.364722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:24.373018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-adf62184-c38d-4c7e-a418-9abf763a0ee3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.156608 Jun 29 10:28:24.373584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1228/2378] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:25.394735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:25.395630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:25.406629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:25.407382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:25.408687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:25.409126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:25.553744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:25.566992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6cc72d36-37c1-41f4-bced-3190f109e9b8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.178705 Jun 29 10:28:25.567737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1151/2379] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:26.588798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:26.589770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:26.593440 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:26.600189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:26.600636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:26.601401 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:26.601833 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:26.756271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:26.765047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3970ed25-907b-4148-95cb-a44212c31ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.182744 Jun 29 10:28:26.765634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1229/2380] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:27.785152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:27.785783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:27.794783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:27.795567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:27.796968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:27.797701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:27.949299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:27.958728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ddcaafd3-b738-43ba-bebc-8fc4e0f931dd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179180 Jun 29 10:28:27.959312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1152/2381] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:28.980836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:28.981835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:28.993766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:28.994511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:28.995807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:28.996523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:29.128053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:29.136390 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-343c70ad-906f-441c-a2aa-74d2154fbdf1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162083 Jun 29 10:28:29.136966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1230/2382] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:30.157522 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:30.158409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:30.169419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:30.170174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:30.171500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:30.172226 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:30.324850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:30.333304 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bef6909d-8387-4593-983b-ca5940404291 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.182521 Jun 29 10:28:30.333855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1153/2383] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:31.360908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:31.361830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:31.373420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:31.374156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:31.375509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:31.376225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:31.528212 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:31.536490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-48332fd3-1e9d-48bb-a06e-512475d5eb63 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.182267 Jun 29 10:28:31.537062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1231/2384] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:32.555513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:32.556467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:32.567247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:32.567694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:32.568448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:32.568874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:32.713091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:32.721544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0c112576-52e1-47e3-a128-d2635d54ace5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170457 Jun 29 10:28:32.722216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1154/2385] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:33.743019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:33.744001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:33.755255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:33.756008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:33.757273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:33.758002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:33.762226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:33.916221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:33.924731 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-26ef54f4-b113-487d-a889-6f9879bb9654 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.188389 Jun 29 10:28:33.925336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1232/2386] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:34.944459 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:34.945276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:34.955140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:34.955814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:34.956892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:34.957513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:35.095677 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:35.106749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2e713e75-6b03-4a90-a625-07ed3bb5a11f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167936 Jun 29 10:28:35.107356 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1155/2387] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:36.129578 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:36.130447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:36.141417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:36.142152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:36.143527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:36.144026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:36.292587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:36.305689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-09c9f024-504f-437f-acbe-fb58d36ed912 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.182508 Jun 29 10:28:36.306405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1233/2388] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:37.327187 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:37.327721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:37.334814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:37.335270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:37.336033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:37.336467 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:37.469970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:37.478698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-58b8b45c-2b3d-4dde-94d9-68e46a21e822 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.155501 Jun 29 10:28:37.479267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1156/2389] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:38.500115 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:38.501095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:38.512221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:38.512967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:38.514223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:38.515006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:38.656290 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:38.664872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e38e8435-eb48-449c-a735-6226141e9287 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171231 Jun 29 10:28:38.665443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1234/2390] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:39.685613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:39.687032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:39.699267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:39.700087 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:39.701330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:39.702063 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:39.839786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:39.848296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-815f675a-df4c-401d-a6f1-aa95f68d5d03 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169364 Jun 29 10:28:39.848870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1157/2391] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:40.325663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:28:40.326335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:28:40.870196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:40.871237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:40.881445 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:40.881884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:40.882688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:40.883166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:41.021094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:41.029281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3eaf1df-3ee4-46cc-b5dc-fc4618c50c7e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165605 Jun 29 10:28:41.029851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1235/2392] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:42.050692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:42.051281 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:42.058359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:42.058843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:42.059613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:42.060047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:42.191589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:42.199668 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1b0e6fa9-dd60-45c1-8bb7-c42bd3eb7532 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.155381 Jun 29 10:28:42.200238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1158/2393] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:43.221032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:43.222338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:43.229156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:43.229606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:43.230368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:43.230832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:43.363956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:43.372538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-833c7f00-1911-43f1-8059-d0916254aaaa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158110 Jun 29 10:28:43.373100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1236/2394] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:44.393525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:44.394290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:44.401542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:44.402006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:44.402848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:44.403295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:44.542769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:44.551501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ebcd6be-6e65-4b61-8e81-15ef6612bcc8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164599 Jun 29 10:28:44.552075 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1159/2395] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:45.573118 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:45.574059 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:45.585169 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:45.585919 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:45.587225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:45.587946 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:45.734382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:45.742813 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b5cbda24-18f2-4e10-9cc5-28c7111b31b7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.176152 Jun 29 10:28:45.743380 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1237/2396] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:46.763972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:46.764971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:46.773228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:46.773683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:46.774453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:46.774927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:46.905798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:46.914501 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8c6a325a-6cdf-40a0-9d9d-674e5bcf425e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157056 Jun 29 10:28:46.915113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1160/2397] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:47.935925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:47.937378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:47.948451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:47.949236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:47.950475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:47.951381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:48.096520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:48.104943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-70c5cd67-6d57-445e-ad94-e940617ce1bd tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175598 Jun 29 10:28:48.105531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1238/2398] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:49.126619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:49.127730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:49.130231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:49.135762 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:49.136213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:49.136977 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:49.137412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:49.280056 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:49.288556 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-150cdb88-d568-4e5c-96fc-815673cadd20 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168513 Jun 29 10:28:49.289129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1161/2399] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:50.309509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:50.310382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:50.323779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:50.324609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:50.325840 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:50.326617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:50.470589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:50.482184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9aed2f04-abb9-4907-b3a1-55b791909f2f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179255 Jun 29 10:28:50.482841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1239/2400] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:51.504418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:51.505189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:51.513543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:51.513989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:51.514796 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:51.515233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:51.646129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:51.654693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d9f7e9ef-dfbb-4413-92e4-5d33958adb0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.156960 Jun 29 10:28:51.655272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1162/2401] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:52.676110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:52.676880 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:52.686012 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:52.687167 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:52.688175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:52.688759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:52.837134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:52.845163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b4280e6c-3cdd-49a3-a016-05986a4dbf21 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175403 Jun 29 10:28:52.845721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1240/2402] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:53.867199 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:53.868219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:53.878715 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:53.879172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:53.879946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:53.880389 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:53.882996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:54.012071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:54.020172 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ca4f24e-0107-49fa-99a4-99700414d9dc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159760 Jun 29 10:28:54.021359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1163/2403] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:55.040843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:55.041357 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:55.047949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:55.048392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:55.049151 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:55.049580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:55.188611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:55.197157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-24380540-c15e-4eff-b0aa-8aa06f4788e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161362 Jun 29 10:28:55.197748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1241/2404] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:56.220945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:56.221967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:56.229769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:56.230198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:56.231011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:56.231439 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:56.364371 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:56.373548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-13cdadcf-e45e-4257-ba9a-043cd3b51bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160643 Jun 29 10:28:56.374115 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1164/2405] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:57.395278 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:57.396516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:57.398972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:28:57.404784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:57.405247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:57.406038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:57.406524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:57.552129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:57.560421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aadcef2c-f4fd-4f03-ad4e-7004e5ec1ff7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171798 Jun 29 10:28:57.560983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1242/2406] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:58.584475 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:58.585506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:58.595999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:58.596757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:58.598038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:58.598880 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:58.728428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:58.736575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0ce5867c-4290-43da-8b33-de02f59c51eb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159020 Jun 29 10:28:58.737146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1165/2407] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:28:59.763569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:28:59.764630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:28:59.773713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:59.774156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:59.774940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:28:59.775371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:28:59.929725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:28:59.942522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-446565de-bb06-43ae-89dc-327b36071eca tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.185368 Jun 29 10:28:59.943313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1243/2408] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:28:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:00.965704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:00.966860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:00.975453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:00.975907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:00.976676 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:00.977110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:01.125635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:01.134105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b139df8-773a-4831-9139-5043297c6a8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174380 Jun 29 10:29:01.134725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1166/2409] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:02.155743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:02.156592 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:02.165754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:02.166199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:02.166993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:02.167426 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:02.312804 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:02.321365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-01f936d9-5b95-48e9-b7f4-dbe10b93ba16 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172294 Jun 29 10:29:02.321931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1244/2410] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:03.341539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:03.342109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:03.348777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:03.349858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:03.350648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:03.351099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:03.488589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:03.497707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d3cf3307-c07c-4ebf-98b5-1cf404aea6e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160160 Jun 29 10:29:03.498286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1167/2411] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:03.750009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:29:03.751111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:29:04.519103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:04.520112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:04.531536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:04.532284 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:04.533535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:04.534262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:04.537784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:04.671952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:04.681552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8816846e-602b-46a3-b855-33c62fb7c47d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168947 Jun 29 10:29:04.682152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1245/2412] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:05.703926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:05.704907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:05.713555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:05.714008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:05.714810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:05.715248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:05.846844 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:05.860000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c891075-5055-499d-b4ff-255db794cc72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162472 Jun 29 10:29:05.860841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1168/2413] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:06.883251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:06.884028 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:06.892498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:06.893077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:06.894021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:06.894585 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:07.037370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:07.046885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3115cf29-8d4d-4af5-a386-03f58f8084e4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169477 Jun 29 10:29:07.047726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1246/2414] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:08.069323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:08.069967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:08.079820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:08.080455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:08.081589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:08.082259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:08.219521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:08.227863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ffe41f66-b384-42a1-b1ec-0b99b97bf6bb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164675 Jun 29 10:29:08.228469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1169/2415] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:09.245670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:09.246303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:09.255202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:09.255713 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:09.256708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:09.257139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:09.414759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:09.425254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d83e77b9-70e4-4fa1-9360-8813d8a5cee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.183367 Jun 29 10:29:09.426201 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1247/2416] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:10.446071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:10.446708 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:10.453685 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:10.454126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:10.454914 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:10.455362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:10.587310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:10.595613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c567783a-183a-4260-acdd-7332edbfc358 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.155103 Jun 29 10:29:10.596180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1170/2417] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:11.617174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:11.617910 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:11.625887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:11.626416 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:11.627350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:11.627860 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:11.765223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:11.775254 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-60404625-b1ad-4c5a-9d91-8c7b93844f6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164729 Jun 29 10:29:11.775773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1248/2418] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:12.793672 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:12.794322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:12.801918 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:12.802387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:12.803219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:12.804250 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:12.939657 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:12.948175 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-26e00cd6-9c12-47c8-b7f9-de5f47c49a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158604 Jun 29 10:29:12.948744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1171/2419] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:13.965736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:13.966352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:13.973325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:13.973779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:13.974534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:13.975017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:14.112382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:14.123334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b424e67b-11cc-4659-a8ad-b09ddb632222 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162056 Jun 29 10:29:14.123909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1249/2420] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:15.143383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:15.144100 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:15.152923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:15.153491 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:15.154444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:15.155043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:15.305542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:15.314335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7dd12ed9-93ba-4008-a902-510853095ee8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175968 Jun 29 10:29:15.314882 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1172/2421] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:16.335789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:16.336865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:16.348299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:16.349055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:16.350353 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:16.351099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:16.486140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:16.497778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-75f3d586-acbf-483b-93fa-f20fcefebc2a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168331 Jun 29 10:29:16.498616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1250/2422] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:17.523801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:17.525129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:17.532759 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:17.533296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:17.534143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:17.534635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:17.679985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:17.688814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-80f431a4-c292-4624-a456-fa3fd1dde3e5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171533 Jun 29 10:29:17.689383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1173/2423] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:18.710133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:18.711163 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:18.722300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:18.723105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:18.724377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:18.725119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:18.868122 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:18.880405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-778ac18e-aeff-4e35-ae6a-8b735ccee421 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.176457 Jun 29 10:29:18.881166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1251/2424] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:19.904910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:19.905519 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:19.907910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:19.913951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:19.914392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:19.915502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:19.915965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:20.052294 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:20.063979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d7c88a90-d21a-4ab0-80ec-6ef33675efbf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162683 Jun 29 10:29:20.064819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1174/2425] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:21.082456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:21.083110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:21.090404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:21.090885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:21.091655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:21.092095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:21.226022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:21.235241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e676137c-b8bc-4293-b0e2-61a227f54192 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.156780 Jun 29 10:29:21.235815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1252/2426] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:22.256073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:22.256690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:22.267072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:22.267592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:22.268778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:22.269403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:22.403725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:22.412288 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f15131d9-2084-4552-9011-b04bf35ad17d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162580 Jun 29 10:29:22.412862 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1175/2427] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:23.433501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:23.434164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:23.441799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:23.442301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:23.443192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:23.443678 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:23.580902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:23.589129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e7e1de0d-5ab9-4bcb-bf87-b425c2691ab5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162107 Jun 29 10:29:23.589758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1253/2428] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:24.611073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:24.612060 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:24.623176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:24.623923 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:24.625192 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:24.625911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:24.630099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:24.765961 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:24.774142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d96d790e-1b6e-41bd-aa74-f5c07e6c87c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169797 Jun 29 10:29:24.774740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1176/2429] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:25.796094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:25.797206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:25.808112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:25.808862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:25.810312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:25.810882 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:25.948808 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:25.957565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-048e8f74-0d97-4eb0-8f90-314169a48274 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168580 Jun 29 10:29:25.958135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1254/2430] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:26.975267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:26.975926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:26.983820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:26.984266 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:26.985025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:26.985453 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:27.126416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:27.134832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cfc5292e-e28c-4273-bd7a-708120d64117 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163516 Jun 29 10:29:27.135391 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1177/2431] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:28.155996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:28.156568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:28.159335 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:28.165724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:28.166234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:28.167125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:28.167603 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:28.314234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:28.322918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dc748e3e-7a6d-4706-a177-fd8be58d0e77 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.173392 Jun 29 10:29:28.323488 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1255/2432] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:29.344013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:29.344608 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:29.351363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:29.351810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:29.352566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:29.352991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:29.488919 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:29.496990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fbe8d92e-68ea-4f83-8fa3-b2153de1d481 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159150 Jun 29 10:29:29.497550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1178/2433] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:30.517926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:30.518716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:30.527074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:30.527632 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:30.528566 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:30.529093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:30.669225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:30.678349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ff28e4f1-cc42-49cb-bed5-a482d490cb81 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166116 Jun 29 10:29:30.678977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1256/2434] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:31.699675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:31.700648 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:31.712070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:31.712832 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:31.714094 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:31.714883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:31.851595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:31.863793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7cc2a772-39d5-4128-9734-45b4386350b2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170420 Jun 29 10:29:31.864548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1179/2435] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:32.885715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:32.886797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:32.895354 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:32.895796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:32.896556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:32.896986 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:33.030041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:33.038539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fdd9dc6e-bd4a-47bf-9ca7-56347af03685 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159420 Jun 29 10:29:33.039132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1257/2436] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:34.064403 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:34.065022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:34.071963 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:34.072419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:34.073184 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:34.073614 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:34.213470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:34.226097 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c67c81c4-f166-4e6f-af32-1537f7ecac69 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167335 Jun 29 10:29:34.226937 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1180/2437] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:35.243745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:35.244379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:35.251665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:35.252142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:35.252906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:35.253342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:35.255900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:35.408609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:35.417047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-23a7c8d1-fc38-422b-978d-2e6dd2963b1f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177380 Jun 29 10:29:35.417611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1258/2438] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:36.438605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:36.440028 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:36.450680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:36.451328 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:36.452478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:36.452823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:36.600937 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:36.609373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7465b5ed-44e4-47b0-bc80-93d95d2a7a8f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177398 Jun 29 10:29:36.609939 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1181/2439] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:37.631606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:37.632702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:37.644364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:37.645105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:37.646349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:37.647108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:37.787096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:37.799725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-32cb9902-a35a-473c-8a7b-e862d704984c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175223 Jun 29 10:29:37.800529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1259/2440] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:38.821643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:38.822652 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:38.831954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:38.832402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:38.833151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:38.833581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:38.967057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:38.976173 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-688073f6-5ba0-45b5-b898-378e2c82b001 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160916 Jun 29 10:29:38.976745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1182/2441] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:39.998473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:39.999523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:40.008148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:40.008597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:40.009347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:40.009776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:40.146179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:40.154548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cdbb79b0-ec11-4069-a3a6-179bd084f8d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162686 Jun 29 10:29:40.155178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1260/2442] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:41.176159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:41.176805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:41.184922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:41.185451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:41.186750 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:41.187582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:41.439123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:41.447968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4a8cb5c4-053e-4744-8e9f-7d08d647c5be tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.278374 Jun 29 10:29:41.448546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1183/2443] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:42.465487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:42.466119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:42.473552 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:42.474029 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:42.474838 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:42.475275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:42.677068 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:42.685192 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-92ccc5aa-6ea2-4bda-a6da-d43001b735e9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.223633 Jun 29 10:29:42.685729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1261/2444] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:43.708373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:43.709352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:43.720629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:43.721383 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:43.723347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:43.723814 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:43.864350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:43.872529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-442d0e9d-b769-430f-bb3e-3fdffed18869 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171858 Jun 29 10:29:43.873102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1184/2445] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:44.898309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:44.898309 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:44.901500 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:44.901951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:44.902721 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:44.903156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:45.036455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:45.044451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dce953bb-b16d-4d44-96fa-e830a811806f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157245 Jun 29 10:29:45.045021 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1262/2446] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:46.061799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:46.062407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:46.070079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:46.070529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:46.071322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:46.071763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:46.212551 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:46.220818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-30a5987e-d7b4-4b46-8fb7-4a3180ccc61c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163346 Jun 29 10:29:46.221431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1185/2447] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:47.242431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:47.243514 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:47.254540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:47.255024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:47.255792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:47.256219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:47.389878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:47.398489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5f7a0709-de79-481d-8714-5b7d64c13283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162861 Jun 29 10:29:47.399116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1263/2448] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:48.421015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:48.422011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:48.430930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:48.431378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:48.432132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:48.432557 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:48.573368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:48.584740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7ee7410a-2e01-4ce5-ad24-a4205329c623 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170343 Jun 29 10:29:48.585305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1186/2449] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:48 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:49.605379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:49.606255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:49.617318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:49.618024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:49.619242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:49.619902 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:49.761689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:49.774553 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c2e86911-c6d8-4db1-b9fc-ba67d82189a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174822 Jun 29 10:29:49.775400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1264/2450] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:50.795807 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:50.796410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:50.798965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:50.804976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:50.805434 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:50.806201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:50.806663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:50.949466 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:50.957711 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7abfd218-e5d1-43e4-ac4c-17d846b1076e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165815 Jun 29 10:29:50.958274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1187/2451] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:51.983954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:51.984971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:51.996658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:51.997450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:51.998691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:51.999418 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:52.154734 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:52.166970 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5cbe5c8c-52b9-4e48-85cd-efff10dbcb58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.189223 Jun 29 10:29:52.167763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1265/2452] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:53.191872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:53.192512 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:53.199591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:53.200038 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:53.200792 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:53.201237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:53.343870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:53.352735 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40478ea8-c46c-4bc5-8827-8f8d89b314e8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167659 Jun 29 10:29:53.353297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1188/2453] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:54.373936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:54.375430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:54.386535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:54.387337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:54.388576 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:54.389288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:54.535238 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:54.547799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-41bf84e9-6b07-4659-9947-a4393b1c5a79 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179935 Jun 29 10:29:54.548612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1266/2454] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:54 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:55.569779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:55.570523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:55.578553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:55.579125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:55.580064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:55.580588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:55.583896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:55.715736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:55.723911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7cc7841b-f757-4fda-ad5d-4e5b3f621781 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160386 Jun 29 10:29:55.724490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1189/2455] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:56.304874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:29:56.305227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:29:56.746268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:56.747260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:56.759250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:56.759998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:56.761239 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:56.761956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:56.918345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:56.930906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2a4f0f42-13f6-4277-b439-9916ac445a85 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.191895 Jun 29 10:29:56.931710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1267/2456] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:57.952487 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:57.953168 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:57.959962 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:57.960412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:57.961178 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:57.961617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:58.097875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:58.105946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1d2ed31e-acaf-4bf8-ba5d-7fbf0cac5769 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157525 Jun 29 10:29:58.106483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1190/2457] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:29:59.129292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:29:59.130449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:29:59.134148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:29:59.143547 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:59.144300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:59.145431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:29:59.145866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:29:59.291313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:29:59.299945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bdb966ae-56e7-4283-aa1d-44a02eebda72 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.177163 Jun 29 10:29:59.300522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1268/2458] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:29:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:00.322601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:00.323525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:00.334269 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:00.334748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:00.335499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:00.335927 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:00.466126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:00.474835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-025d1784-628b-4d02-9367-f73f43e12dc1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.159429 Jun 29 10:30:00.475395 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1191/2459] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:01.501433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:01.502425 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:01.510392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:01.510886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:01.511689 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:01.512142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:01.661323 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:01.669791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cee904e0-7998-4ac7-9789-d796ca223575 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174920 Jun 29 10:30:01.670392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1269/2460] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:01 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:02.691323 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:02.692378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:02.703477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:02.704293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:02.705565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:02.706301 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:02.840010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:02.848539 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8ca5e100-51d9-4531-847a-719baadce9c9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164170 Jun 29 10:30:02.849210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1192/2461] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:03.865777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:03.866347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:03.873625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:03.874065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:03.874886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:03.875330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:04.020670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:04.029226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3d295765-a8fd-4765-8984-fed49496da15 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167507 Jun 29 10:30:04.029790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1270/2462] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:05.050533 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:05.051469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:05.058900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:05.059360 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:05.060429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:05.061223 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:05.195399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:05.206361 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-dc82a4c7-ed07-44fe-a92b-962b0a53fad4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162501 Jun 29 10:30:05.207363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1193/2463] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:06.227367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:06.228026 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:06.238084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:06.238807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:06.239993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:06.240669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:06.244617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:06.404744 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:06.412885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-90c5b4e4-273b-4ba5-9b07-de08f82425d2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.190770 Jun 29 10:30:06.413471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1271/2464] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:07.432457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:07.433047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:07.443146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:07.443593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:07.444358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:07.444790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:07.586931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:07.595068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3394b46a-76f0-4592-8a7c-776c6f4cd0d8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168228 Jun 29 10:30:07.595635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1194/2465] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:07 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:08.619359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:08.620325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:08.632200 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:08.632978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:08.634230 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:08.635025 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:08.776132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:08.789299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ab4156ad-a89a-4734-8fc4-c68276a3fd12 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.176380 Jun 29 10:30:08.789964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1272/2466] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:09.815198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:09.816043 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:09.823904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:09.824330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:09.825118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:09.825547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:09.978900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:09.993778 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-62045c1a-edf8-4ecc-b276-2a3b85a1e859 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.185311 Jun 29 10:30:09.994609 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1195/2467] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:11.013336 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:11.013976 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:11.022447 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:11.022957 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:11.023729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:11.024171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:11.164688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:11.173291 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9267925b-b22d-425e-8c31-8cc6df6190af tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165503 Jun 29 10:30:11.174144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1273/2468] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:12.196231 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:12.196889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:12.205351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:12.205902 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:12.206887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:12.207424 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:12.343196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:12.351728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-14e1b1d9-8d65-466a-b51f-cfae812c0bcc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162828 Jun 29 10:30:12.352309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1196/2469] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:13.371865 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:13.372679 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:13.381676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:13.382140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:13.382937 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:13.383422 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:13.518152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:13.526923 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8141fcb4-fbd2-4afa-b081-7f60aee88209 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160795 Jun 29 10:30:13.527489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1274/2470] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:13 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:14.544713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:14.545337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:14.552693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:14.553140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:14.553878 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:14.554308 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:14.690543 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:14.698764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-660309a7-dbf1-44c3-9d63-5921401a1523 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157915 Jun 29 10:30:14.699335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1197/2471] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:15.716968 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:15.717611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:15.725579 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:15.726030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:15.726837 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:15.727269 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:15.878003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:15.887871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b641d3d9-5738-4110-99c8-3cbe6d9ca363 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.175605 Jun 29 10:30:15.888443 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1275/2472] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:16.905224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:16.906070 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:16.917721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:16.918454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:16.919745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:16.920464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:17.064086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:17.072603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ce6e6f02-57ef-468e-b558-de224b22e1ee tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171257 Jun 29 10:30:17.073176 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1198/2473] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:17.849006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:30:17.849285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:30:18.090521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:18.091152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:18.097898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:18.098339 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:18.099186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:18.099543 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:18.232669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:18.244727 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63bbc3c3-9334-4d1b-b4cd-1eb44bc0d5fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158125 Jun 29 10:30:18.245351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1276/2474] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:19.262694 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:19.263262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:19.270310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:19.270802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:19.271566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:19.272001 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:19.407335 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:19.420007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e81ad5ab-d75c-4d6b-88c1-ca9692c761e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161048 Jun 29 10:30:19.420901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1199/2475] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:20.438598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:20.439219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:20.446961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:20.447400 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:20.448166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:20.448593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:20.595095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:20.606158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9a06d190-47cb-41e3-92a5-a973fa34fdf8 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171814 Jun 29 10:30:20.606736 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1277/2476] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:20 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:21.623550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:21.624125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:21.626763 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:21.632581 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:21.633095 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:21.633863 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:21.634299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:21.769439 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:21.777702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0d615cf9-2ae6-4527-ada6-c38f2ed64952 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158238 Jun 29 10:30:21.778274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1200/2477] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:22.804650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:22.806389 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:22.817519 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:22.818251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:22.819555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:22.820433 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:22.961405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:22.979220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b9b3d8fa-d17e-4c3c-8cf8-77d9b60ae79a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.181098 Jun 29 10:30:22.979807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1278/2478] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:23.998254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:23.998905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:24.005895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:24.006347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:24.007144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:24.007584 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:24.138701 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:24.147169 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6010b386-987e-41a2-bd53-2cff5dc17811 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.152845 Jun 29 10:30:24.147670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1201/2479] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:25.170444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:25.171450 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:25.180917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:25.181716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:25.182483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:25.182969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:25.324033 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:25.332404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-91758c6b-bc0c-4307-96bc-e541f6f70ca7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168351 Jun 29 10:30:25.332983 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1279/2480] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:26.349783 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:26.350545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:26.357825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:26.358270 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:26.359059 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:26.359461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:26.361989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:26.745105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:26.757309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-369ead87-c73e-4692-915d-9afa220bde58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.411498 Jun 29 10:30:26.758102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1202/2481] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:26 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:27.776901 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:27.777681 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:27.787629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:27.788228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:27.789225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:27.789806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:27.929499 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:27.939404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bd7c07fe-2f39-4aeb-b9fa-32d6b131a39d tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167631 Jun 29 10:30:27.939977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1280/2482] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:28.959992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:28.960743 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:28.968370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:28.968819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:28.969576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:28.970006 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:29.116769 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:29.125089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2febef12-f6e8-4d4d-a7c7-2a7c5a7bd24a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171564 Jun 29 10:30:29.125658 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1203/2483] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:30.141947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:30.142589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:30.144992 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:30.150797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:30.151263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:30.152031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:30.152536 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:30.289260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:30.298668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0915ab1e-cdad-4f30-b8a2-d25270d2bc10 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160604 Jun 29 10:30:30.299228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1281/2484] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:31.317022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:31.317662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:31.325022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:31.325481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:31.326362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:31.326823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:31.468010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:31.479692 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-902382b4-03e6-4544-9717-a174f773d0fe tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166657 Jun 29 10:30:31.480251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1204/2485] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:31 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:32.498365 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:32.499055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:32.506219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:32.506741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:32.507510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:32.507949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:32.647040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:32.656008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-44539ee5-ab34-4030-8a46-d04661a99457 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162298 Jun 29 10:30:32.656587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1282/2486] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:33.673462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:33.674053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:33.681148 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:33.681601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:33.682387 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:33.682908 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:33.819542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:33.827812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c93d5763-c1b4-4642-8d74-4b3e516c7250 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158323 Jun 29 10:30:33.828567 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1205/2487] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:34.845044 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:34.845655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:34.852613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:34.853049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:34.853807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:34.854224 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:34.988648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:34.997398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7ebcc1ef-3f39-4173-9813-a51e08116cea tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.156212 Jun 29 10:30:34.998058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1283/2488] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:36.015217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:36.015795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:36.023872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:36.024313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:36.025077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:36.025499 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:36.160412 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:36.168579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b508a7a8-b71e-4093-a948-a9f0e04d84c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157462 Jun 29 10:30:36.169144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1206/2489] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:37.186008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:37.186644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:37.193648 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:37.194071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:37.194862 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:37.195286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:37.197774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:37.341317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:37.349667 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d2dcccfb-f602-41b5-830a-0f2ebb6150c1 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.168186 Jun 29 10:30:37.350235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1284/2490] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:38.371271 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:38.372177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:38.379490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:38.379947 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:38.380713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:38.381149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:38.534318 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:38.548484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-57ecd0cc-0906-4263-95cc-ebad8304446e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.183756 Jun 29 10:30:38.549316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1207/2491] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:38 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:39.569609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:39.570260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:39.577960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:39.578405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:39.579188 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:39.579619 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:39.719251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:39.731469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-88a91322-26f0-41f9-ba97-3ed210f105bf tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165609 Jun 29 10:30:39.732206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1285/2492] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:40.757402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:40.758422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:40.769620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:40.770368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:40.771689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:40.772409 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:40.926915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:40.935817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-6ae9b454-4055-478e-9d87-0ec39b2d2d13 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.184645 Jun 29 10:30:40.936388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1208/2493] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:41.955810 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:41.956634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:41.964961 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:41.965518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:41.966454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:41.967030 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:42.107629 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:42.120093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d27f6091-1b3d-4bfa-aa60-cadfb55799fa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169439 Jun 29 10:30:42.120948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1286/2494] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:43.143084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:43.144146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:43.155431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:43.155922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:43.156695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:43.157134 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:43.294669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:43.303000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7dda3815-326e-4ba5-89d6-c8e3acf856c3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166490 Jun 29 10:30:43.303565 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1209/2495] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:44.325007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:44.325980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:44.338041 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:44.338844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:44.340119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:44.340829 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:44.599263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:44.611652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4da1e526-2ad9-4507-bd75-8dad6b4e86e3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.293296 Jun 29 10:30:44.612383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1287/2496] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:44 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:45.634766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:45.635493 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:45.643505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:45.643954 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:45.644714 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:45.645143 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:45.775906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:45.784167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-df654642-bc1d-4baa-bb08-46162dd5a986 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.153862 Jun 29 10:30:45.784737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1210/2497] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:46.805904 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:46.806913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:46.816895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:46.817348 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:46.818107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:46.818545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:46.953773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:46.963932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5096aef8-2579-46ef-8fa4-858a2ef63414 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164601 Jun 29 10:30:46.964512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1288/2498] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:46 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:47.985675 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:47.986905 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:47.993580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:47.994025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:47.994831 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:47.995264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:48.131936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:48.144817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-175309e6-abb6-4117-b0c1-8c5bcb863a1c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165257 Jun 29 10:30:48.145572 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1211/2499] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:47 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:49.171232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:49.172276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:49.180181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:49.180624 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:49.181372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:49.181798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:49.325620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:49.335205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cda3a942-620c-440f-bfe0-21b499c46f86 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170726 Jun 29 10:30:49.335807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1289/2500] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:49 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:50.356674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:50.357575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:50.369367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:50.370119 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:50.371458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:50.372181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:50.512995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:50.521492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-871dfb63-e11f-4fdf-9081-cd716052095a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171358 Jun 29 10:30:50.522062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1212/2501] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:50 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:51.542925 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:51.543898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:51.553136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:51.553586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:51.554352 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:51.554885 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:51.689963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:51.698174 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6d2635f4-bf01-4741-99af-6efd26ddc8d5 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.161689 Jun 29 10:30:51.698770 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1290/2502] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:51 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:52.719942 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:52.720866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:52.723471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:52.729630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:52.730131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:52.731027 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:52.731513 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:52.876785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:52.885309 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-28a2b7f5-c3dc-43a4-81a4-e7ede4f0ba8a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172093 Jun 29 10:30:52.885904 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1213/2503] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:52 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:53.906653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:53.907374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:53.917243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:53.917875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:53.919076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:53.919666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:54.055965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:54.064739 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0538ca32-2c8f-4a04-b5f6-be2b17755e46 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164598 Jun 29 10:30:54.065306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1291/2504] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:53 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:55.082337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:55.082761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:55.089407 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:55.089860 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:55.090600 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:55.091067 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:55.232679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:55.242286 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-32f443bb-4082-4c3f-b3bb-e731817e8d78 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164667 Jun 29 10:30:55.242887 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1214/2505] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:55 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:56.259918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:56.260501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:56.268022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:56.268468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:56.269221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:56.269685 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:56.406008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:56.414604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-36101ea1-25b1-464a-af44-c75bdf432a75 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.158631 Jun 29 10:30:56.415211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1292/2506] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:56 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:57.440428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:57.441062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:57.450745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:57.451195 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:57.452105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:57.452643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:57.456660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:30:57.586970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:57.596458 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb9d1cc6-17fc-406d-82b8-71f959465002 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162834 Jun 29 10:30:57.597233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1215/2507] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:57 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:58.620328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:58.621643 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:58.630358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:58.630836 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:58.631589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:58.632020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:58.765193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:58.778362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d37c1eeb-0c11-4666-b066-b3981a87c7da tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164474 Jun 29 10:30:58.779193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1293/2508] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:58 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:30:59.801445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:30:59.802071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:30:59.808920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:59.809370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:59.810500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:30:59.810965 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:30:59.955686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:30:59.966007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4c585640-8b87-4132-8241-e565d0240e62 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170734 Jun 29 10:30:59.966896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1216/2509] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:30:59 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:00.990510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:00.991282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:00.993617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:31:00.999504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:00.999980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:01.000773 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:01.001203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:01.144349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:01.152694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b7f2b590-1c6e-409c-8466-10570c0ef551 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167428 Jun 29 10:31:01.153264 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1294/2510] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:00 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:02.174402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:02.175465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:02.186890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:02.187645 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:02.188895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:02.189892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:02.332454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:02.341504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-de604356-8a76-4dc3-833e-2e74fc77ad98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.173576 Jun 29 10:31:02.342093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1217/2511] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:02 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:03.361895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:03.362807 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:03.370056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:03.370512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:03.371305 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:03.371741 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:03.504633 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:03.512971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-51dde212-03d2-44a4-8ea2-0dec4c12237e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.157705 Jun 29 10:31:03.513565 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1295/2512] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:03 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:04.533370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:04.534396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:04.545488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:04.546244 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:04.547547 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:04.548275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:04.696419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:04.708237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1a4fedac-77f8-4140-8d2a-617096db6f52 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.181202 Jun 29 10:31:04.708835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1218/2513] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:04 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:05.732331 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:05.733347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:05.744403 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:05.745157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:05.746414 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:05.747191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:05.885954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:05.897750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2dcd5ebd-fa59-4ab0-ba98-2ff567447a19 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172282 Jun 29 10:31:05.898473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1296/2514] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:05 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:06.919072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:06.919815 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:06.928282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:06.928670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:06.929438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:06.929877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:07.070299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:07.078526 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8249c4db-2098-4262-84bf-4267224672e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166296 Jun 29 10:31:07.079104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1219/2515] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:06 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:08.096551 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:08.097139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:08.107421 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:08.107872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:08.108640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:08.109225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:08.112140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:31:08.252798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:08.262215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a289b05-e10a-4921-b848-5140d9944b0e tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.169664 Jun 29 10:31:08.262792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1297/2516] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:08 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:09.284349 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:09.285277 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:09.296599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:09.297359 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:09.298725 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:09.299444 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:09.436191 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:09.445529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-413d6921-2c33-49ae-9c6e-01b2805fdf66 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167810 Jun 29 10:31:09.446190 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1220/2517] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:09 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:10.462795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:10.463622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:10.471857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:10.472314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:10.473281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:10.473706 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:10.621908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:10.631827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d987e54f-03bd-4d98-85b0-9c1ba108d8fb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172606 Jun 29 10:31:10.632637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1298/2518] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:10 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:11.654241 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:11.655815 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:11.662702 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:11.663152 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:11.663909 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:11.664337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:11.817402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:11.826103 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-58095a89-c08e-4fce-91f9-1776b0a3f3a0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.176982 Jun 29 10:31:11.826693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1221/2519] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:11 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:12.848237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:12.849382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:12.862714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:12.863516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:12.864384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:12.864841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:13.020170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:13.028333 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2de684a0-1ba7-4dbb-b788-24e3f4889e0c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.187197 Jun 29 10:31:13.028943 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1299/2520] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:12 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:14.047991 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:14.048800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:14.058554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:14.060020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:14.060751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:14.061373 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:14.200737 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:14.213757 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-64694365-0c8d-4004-9b65-92b701de11d7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171071 Jun 29 10:31:14.214630 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1222/2521] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:14 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:15.238686 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:15.239748 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:15.246557 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:15.247043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:15.247796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:15.248226 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:15.396257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:15.404437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-09f02bfa-183e-40b4-b878-5c67659631b4 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172359 Jun 29 10:31:15.404999 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1300/2522] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:15 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:16.426076 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:16.427003 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:16.438549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:16.439350 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:16.440601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:16.441317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:16.581895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:16.590285 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0949d245-be8c-46fe-9413-3c79959dce98 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.170819 Jun 29 10:31:16.590907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1223/2523] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:16 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:17.611855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:17.612783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:17.624844 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:17.625600 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:17.626997 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:17.627722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:17.767349 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:17.779764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-edc5ee54-a739-4faa-a344-d36d237ee7b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174156 Jun 29 10:31:17.780310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1301/2524] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:17 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:18.801064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:18.802047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:18.810215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:18.810699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:18.811454 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:18.811881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:18.953670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:18.961817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-67f3d523-82c9-403c-8da0-c8c1c20a2543 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167425 Jun 29 10:31:18.962380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1224/2525] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:18 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:19.980300 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:19.981001 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:19.989016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:19.989545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:19.990439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:19.991127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:20.132018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:20.140391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-57dfdee6-78af-4691-b1af-ff28bdd811e0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.164787 Jun 29 10:31:20.140962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1302/2526] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:19 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:21.161688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:21.163438 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:21.174364 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:21.175174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:21.176423 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:21.177151 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:21.326041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:21.334842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8e31b2b7-53e1-4c49-997f-a998e984c4a9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.179566 Jun 29 10:31:21.335520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1225/2527] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:21 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:22.355099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:22.355858 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:22.364859 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:22.365459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:22.366475 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:22.367097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:22.509790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:22.522338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-be7cc7aa-6b9f-46a2-94b3-64b5d037426c tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172908 Jun 29 10:31:22.522949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1303/2528] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:22 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:23.540321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:23.540932 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:23.543296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=26 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:31:23.548772 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:23.549215 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:23.549967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:23.550390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:23.698432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:23.707390 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f7e8ffdc-0049-4678-9372-a5101bb40edb tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.171484 Jun 29 10:31:23.707969 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1226/2529] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:23 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:24.728742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:24.729769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:24.740137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:24.740890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:24.742287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:24.742847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:24.895481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:24.905017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ea9d8ded-c503-4d0e-925e-82a532817bb3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.183049 Jun 29 10:31:24.905593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1304/2530] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:24 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:25.926928 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:25.927850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:25.940203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:25.940967 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:25.942249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:25.943053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:26.078053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:26.086445 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-508ffba1-0b77-488d-8be6-71c9bc94b96b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166289 Jun 29 10:31:26.087023 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1227/2531] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:25 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:27.105564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:27.106334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:27.115490 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:27.116088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:27.117057 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:27.117842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:27.256797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:27.266061 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc7b5a7c-dc5e-4a7a-b2cf-97b4066fa69b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165813 Jun 29 10:31:27.266622 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1305/2532] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:27 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:28.288482 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:28.289354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:28.296179 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:28.296635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:28.297396 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:28.297827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:28.300386 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=78 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:31:28.439604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:28.448133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a906a6b4-ec1b-4551-8197-64994895985b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166606 Jun 29 10:31:28.448699 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1228/2533] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:28 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:29.467017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:29.467608 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:29.474432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:29.474908 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:29.475666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:29.476093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:29.859650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:29.867675 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-0d8464b9-c070-4099-885e-07db850676ac tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.404649 Jun 29 10:31:29.868712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1306/2534] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:29 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:30.889544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:30.890705 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:30.900872 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:30.901331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:30.902088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:30.902521 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:31.040150 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:31.049428 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c9ff3bb5-8f40-4c66-864b-6845c181692a tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.166090 Jun 29 10:31:31.050234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1229/2535] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:30 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:32.072184 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:32.072805 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:32.075175 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=26 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:31:32.080913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:32.081364 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:32.082125 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:32.082555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:32.217752 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:32.226270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-98d7593f-02f9-486b-904e-aa4f7f2f7028 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.160732 Jun 29 10:31:32.226872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1307/2536] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:32 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:33.247363 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:33.248129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:33.256626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:33.257183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:33.258112 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:33.258689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:33.400851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:33.408994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e0fe108e-153d-4b99-829e-601ddacc27b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167102 Jun 29 10:31:33.409559 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1230/2537] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:33 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:34.431669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:34.432379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:34.440052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:34.440525 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:34.441328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:34.441783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:34.581612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:34.589996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-027f8949-d0a8-4d1a-9b23-c0eaee800bfa tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.165026 Jun 29 10:31:34.590586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1308/2538] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:34 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:35.612307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:35.613247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:35.624276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:35.625022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:35.626254 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:35.627019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:35.781643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:35.790021 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-45d05926-f0c2-4d73-a1a4-6fcecec37953 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.184538 Jun 29 10:31:35.790601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1231/2539] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:35 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:36.812170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:36.813193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:36.824205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:36.824956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:36.826213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:36.827010 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:36.964630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:36.973185 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4cd95137-4256-4cdb-a38f-0f67e93584e2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167897 Jun 29 10:31:36.973758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1309/2540] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:36 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:37.992571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:37.993189 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:38.000628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:38.001080 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:38.001840 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:38.002282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:38.139690 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:38.152336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0f6d67f1-e3dd-49a9-9556-67853b75a948 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.163770 Jun 29 10:31:38.152933 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1232/2541] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:37 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:39.178962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:39.179985 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:39.188596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:39.189052 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:39.189803 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:39.190235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:39.192776 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=78 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:31:39.345121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:39.355929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-99dbdaad-3c3b-49c4-971e-0a05490653b6 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.183473 Jun 29 10:31:39.356505 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1310/2542] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:39 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:40.378265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:40.379130 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:40.389877 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:40.390636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:40.391780 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:40.392451 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:40.533247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:40.546786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-99349239-a6ce-4bb7-a69d-f4aac494fea9 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.174374 Jun 29 10:31:40.547848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1233/2543] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:40 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:41.568789 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:41.569737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:41.578593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:41.579055 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:41.579817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:41.580251 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:41.712879 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:41.725337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-50496e96-a5f2-4262-bd2b-e373a1dae3e7 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.162793 Jun 29 10:31:41.726195 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1311/2544] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:41 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:42.748132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:42.748864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:42.757418 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:42.757989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:42.758979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:42.759523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:42.906748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:42.914836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7927ac05-cd10-4a01-8373-dd54f886bb49 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.172824 Jun 29 10:31:42.915398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1234/2545] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:42 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:43.932966 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:43.933554 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:43.941086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:43.941535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:43.942288 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:43.942745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:44.074914 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:44.083271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e7aa2e9d-cc84-4435-b1f9-a8748c3991b0 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.154255 Jun 29 10:31:44.083841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1312/2546] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:43 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:45.103400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:45.103983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 17a2e166-d693-45f2-bc7f-16c59da0aa02] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:31:45.114224 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:45.114881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:45.115980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:45.116544 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:45.256728 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:31:45.264985 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-91258d19-bed0-4aab-856a-e89182e19c58 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02" status: 200 len: 1734 microversion: 2.1 time: 0.167513 Jun 29 10:31:45.265585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1235/2547] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:31:45 2022] GET /compute/v2.1/servers/17a2e166-d693-45f2-bc7f-16c59da0aa02 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:31:45.281375 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1981ee49-f0cc-4c3a-a1bf-ae34d65ffc28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '.version_select at 0x7f3870027c10>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:31:45.284528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1981ee49-f0cc-4c3a-a1bf-ae34d65ffc28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [18f7360d-afdb-4390-a666-f88b5511f48c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 10:31:46.298522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [None req-1981ee49-f0cc-4c3a-a1bf-ae34d65ffc28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [18f7360d-afdb-4390-a666-f88b5511f48c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 51512. Jun 29 10:31:46.326656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1981ee49-f0cc-4c3a-a1bf-ae34d65ffc28 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504965782" status: 202 len: 0 microversion: 2.1 time: 1.049151 Jun 29 10:31:46.327277 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1313/2548] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 10:31:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504965782 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:31:47.340707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-ba81e7bb-80a8-45cc-bcf2-ae156b5f5bf4 req-aea18f5f-3389-48c7-9a2f-9238949ffd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:31:47.350999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ba81e7bb-80a8-45cc-bcf2-ae156b5f5bf4 req-aea18f5f-3389-48c7-9a2f-9238949ffd75 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:31:47.351442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-ba81e7bb-80a8-45cc-bcf2-ae156b5f5bf4 req-aea18f5f-3389-48c7-9a2f-9238949ffd75 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:31:47.363376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-ba81e7bb-80a8-45cc-bcf2-ae156b5f5bf4 req-aea18f5f-3389-48c7-9a2f-9238949ffd75 service nova] Creating event network-changed:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:31:47.376322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-ba81e7bb-80a8-45cc-bcf2-ae156b5f5bf4 req-aea18f5f-3389-48c7-9a2f-9238949ffd75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098330 Jun 29 10:31:47.376322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1236/2549] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:32:00.337613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:32:00.338412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:32:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:32:23.762275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:32:23.763338 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:33:16.318338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:33:16.319348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:33:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:33:37.858660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:33:37.859443 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:33:40.318758 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4b9a1cfb-8ad6-441d-bc2a-1e8a3dbf7325] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 10:33:40.319456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=17 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:40.319954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:40.326535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:40.327063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:40.334742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:40.336014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:40.337160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:40.337596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:40.357382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] HTTP exception thrown: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Request method failure captured: Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 HTTP/1.1 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJJ6OxEq8vkrBd62dLFugOsczzcQNGB1vaOqH65Y21E6RFoQqxfOgeYuOcYxmPDkTmruSTeJelVJIdNSDXenjLphTQIK9qPX9H9wg7zjn5AJgTtvSitkkXmgrick7kiXKl-c6Eoy9l09zYsu1sP-4_Cof5-e_LsSdTsNwQQV3HJ_iA Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:33:40.359725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f57102c066054370a153fb18dc4bc428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f57102c066054370a153fb18dc4bc428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 7900ba750c5f4e9faa69baaed1fd95d7 Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.361728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '18247887-76cd-4d14-b694-3aaa572ca574'} Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:33:40.363020 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.364783 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.366696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Returning 404 to user: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:33:40.366696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1cc3cd58-d7a5-4b7c-b18f-9e8949f287ce tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 404 len: 111 microversion: 2.20 time: 0.045786 Jun 29 10:33:40.366696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1314/2550] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 10:33:40 2022] DELETE /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:33:40.368745 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=21 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:40.369498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=49 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:40.374326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:40.375193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] [instance: 18247887-76cd-4d14-b694-3aaa572ca574] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:40.382948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:40.384084 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:40.384892 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:40.385527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:40.400448 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-228152641", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "networks": [{"uuid": "737b2711-5045-4982-80e4-c97cab2e2a44"}]}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:40.403684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] HTTP exception thrown: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Request method failure captured: Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 HTTP/1.1 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJJ6OxEq8vkrBd62dLFugOsczzcQNGB1vaOqH65Y21E6RFoQqxfOgeYuOcYxmPDkTmruSTeJelVJIdNSDXenjLphTQIK9qPX9H9wg7zjn5AJgTtvSitkkXmgrick7kiXKl-c6Eoy9l09zYsu1sP-4_Cof5-e_LsSdTsNwQQV3HJ_iA Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:33:40.405436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f57102c066054370a153fb18dc4bc428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f57102c066054370a153fb18dc4bc428"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f57102c066054370a153fb18dc4bc428"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: f57102c066054370a153fb18dc4bc428 Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-469607981 Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 7900ba750c5f4e9faa69baaed1fd95d7 Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeShelveTestJSON-469607981-project Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.407336 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '18247887-76cd-4d14-b694-3aaa572ca574'} Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:33:40.408196 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. Jun 29 10:33:40.410040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:40.411601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] Returning 404 to user: Instance 18247887-76cd-4d14-b694-3aaa572ca574 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:33:40.411601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bb3e92ad-3def-419e-9d6d-9bff3e7c5986 tempest-AttachVolumeShelveTestJSON-469607981 tempest-AttachVolumeShelveTestJSON-469607981-project] 10.222.0.52 "GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574" status: 404 len: 111 microversion: 2.20 time: 0.040526 Jun 29 10:33:40.411601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1237/2551] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 10:33:40 2022] GET /compute/v2.1/servers/18247887-76cd-4d14-b694-3aaa572ca574 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 10:33:40.459661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] validate_networks() for [('737b2711-5045-4982-80e4-c97cab2e2a44', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:33:41.328820 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] [4b9a1cfb-8ad6-441d-bc2a-1e8a3dbf7325] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52450. Jun 29 10:33:41.395050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:33:41.395489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:33:41.396200 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:33:41.396924 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:33:41.397597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:33:41.408430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:41.408878 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:41.409676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:41.410116 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:41.428276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Getting quotas for project 4779579fbd6f42dcb6ad98e752ef741c. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:33:41.433666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Getting quotas for user 43964a0e6b48487bb90c5356d312b60d and project 4779579fbd6f42dcb6ad98e752ef741c. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:33:41.447263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:33:41.449715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:33:41.502094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-55cce918-e5eb-4f74-88df-9b509effc733 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105494 Jun 29 10:33:41.502720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1315/2552] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 10:33:41.514109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-89f98807-9eba-4543-8a69-35a2668ae82d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:41.514746 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-89f98807-9eba-4543-8a69-35a2668ae82d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:41.580055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-89f98807-9eba-4543-8a69-35a2668ae82d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:41.587133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-89f98807-9eba-4543-8a69-35a2668ae82d tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1218 microversion: 2.1 time: 0.077374 Jun 29 10:33:41.588553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1238/2553] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:41 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:42.486704 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-a07deb51-a1b7-4175-93c1-da250a26bc17 req-545deb67-a8d7-4516-ad70-50847b50b1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a2e166-d693-45f2-bc7f-16c59da0aa02", "name": "network-vif-deleted", "tag": "1f22aefe-5c3a-4b99-a1b3-e4035c19955a"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:42.512016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a07deb51-a1b7-4175-93c1-da250a26bc17 req-545deb67-a8d7-4516-ad70-50847b50b1e7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:42.515439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-a07deb51-a1b7-4175-93c1-da250a26bc17 req-545deb67-a8d7-4516-ad70-50847b50b1e7 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:42.537691 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-a07deb51-a1b7-4175-93c1-da250a26bc17 req-545deb67-a8d7-4516-ad70-50847b50b1e7 service nova] Creating event network-vif-deleted:1f22aefe-5c3a-4b99-a1b3-e4035c19955a for instance 17a2e166-d693-45f2-bc7f-16c59da0aa02 on hv-cinder-76810 Jun 29 10:33:42.544590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-a07deb51-a1b7-4175-93c1-da250a26bc17 req-545deb67-a8d7-4516-ad70-50847b50b1e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068923 Jun 29 10:33:42.550774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1316/2554] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:42.605604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:42.611118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:42.621086 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:42.621800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:42.622845 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:42.623481 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:42.765221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:42.780426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d09a912d-f23d-4e8f-9df6-2a2dd5f70a7f tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1278 microversion: 2.1 time: 0.178782 Jun 29 10:33:42.781431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1239/2555] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:42 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:42.907978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-c9740a39-275a-4634-8968-fca32d43914f req-8f6ee87a-64f6-4327-82c6-768ab00869e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79b46e7-cd1e-460d-a080-132fa6764043", "name": "network-vif-deleted", "tag": "34516eb4-1014-4903-8787-89e722f30c9c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:42.917604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c9740a39-275a-4634-8968-fca32d43914f req-8f6ee87a-64f6-4327-82c6-768ab00869e6 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:42.918826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-c9740a39-275a-4634-8968-fca32d43914f req-8f6ee87a-64f6-4327-82c6-768ab00869e6 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:42.939018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-c9740a39-275a-4634-8968-fca32d43914f req-8f6ee87a-64f6-4327-82c6-768ab00869e6 service nova] Creating event network-vif-deleted:34516eb4-1014-4903-8787-89e722f30c9c for instance e79b46e7-cd1e-460d-a080-132fa6764043 on hv-cinder-76810 Jun 29 10:33:42.944282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-c9740a39-275a-4634-8968-fca32d43914f req-8f6ee87a-64f6-4327-82c6-768ab00869e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169352 Jun 29 10:33:42.944933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1317/2556] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:33:43.801706 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:43.804827 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:43.814310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:43.815264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:43.816312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:43.817342 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:44.033504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:44.052943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a41098f7-2df9-4cad-8778-49e4aa67e7b3 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.259231 Jun 29 10:33:44.065117 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1240/2557] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:43 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:33:44.583794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-10d48211-c8a6-48d1-bc4c-a0960fc35794 req-02d330b7-6b9b-46da-8846-706ddc5d7012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25177d99-e25b-4526-8830-d62813053298", "tag": "80106497-356e-4e51-8624-c23c37bce622"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:44.596087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-10d48211-c8a6-48d1-bc4c-a0960fc35794 req-02d330b7-6b9b-46da-8846-706ddc5d7012 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:44.596800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-10d48211-c8a6-48d1-bc4c-a0960fc35794 req-02d330b7-6b9b-46da-8846-706ddc5d7012 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:44.612377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-10d48211-c8a6-48d1-bc4c-a0960fc35794 req-02d330b7-6b9b-46da-8846-706ddc5d7012 service nova] Creating event network-changed:80106497-356e-4e51-8624-c23c37bce622 for instance 25177d99-e25b-4526-8830-d62813053298 on hv-cinder-76810 Jun 29 10:33:44.618368 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-10d48211-c8a6-48d1-bc4c-a0960fc35794 req-02d330b7-6b9b-46da-8846-706ddc5d7012 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Jun 29 10:33:44.619641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1318/2558] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:45.070994 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:45.071622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:45.079072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:45.079859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:45.080822 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:45.081426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:45.258997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:45.267310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e68b852c-ed2a-4abf-a4f1-05fca2cb035b tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.200379 Jun 29 10:33:45.268303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1241/2559] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:45 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:33:46.285630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:46.286377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:46.293207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:46.293717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:46.294708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:46.295492 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:46.545193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:46.554528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5f333020-9bba-4382-b8ce-d00e1a99f30e tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.273681 Jun 29 10:33:46.555147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1319/2560] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:46 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:47.028828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-720a08f4-aa7e-4dee-9f44-c74464454f76 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Action: 'create', calling method: .version_select at 0x7f38702181f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2077593480", "metadata": {"Type": "work"}}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:47.368265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-720a08f4-aa7e-4dee-9f44-c74464454f76 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.462100 Jun 29 10:33:47.369074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1242/2561] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 10:33:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 10:33:47.380202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2bf4f070-2b04-495c-aac1-a69a9b4eb660 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Calling method '.version_select at 0x7f3870027160>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:47.430485 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2bf4f070-2b04-495c-aac1-a69a9b4eb660 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5" status: 200 len: 353 microversion: 2.1 time: 0.054121 Jun 29 10:33:47.431138 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1320/2562] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:33:47 2022] GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:47.572379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:47.573302 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:47.581280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:47.581724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:47.582477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:47.582943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:47.722202 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:47.730464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4e12f966-90ab-4a96-a7fe-9d655ce185e6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.162145 Jun 29 10:33:47.731061 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1243/2563] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:47 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:48.445318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-aa87d0b9-cd0d-4991-a0fd-9b4bf714873d tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Calling method '.version_select at 0x7f38700a5670>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:48.503802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-aa87d0b9-cd0d-4991-a0fd-9b4bf714873d tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5" status: 200 len: 354 microversion: 2.1 time: 0.063079 Jun 29 10:33:48.504370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1321/2564] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:33:48 2022] GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:48.515503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ad9a3298-1e0e-4fbb-a0c2-247e24fe2991 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Calling method '.version_select at 0x7f3870218550>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:48.572550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ad9a3298-1e0e-4fbb-a0c2-247e24fe2991 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5" status: 200 len: 354 microversion: 2.1 time: 0.060775 Jun 29 10:33:48.573127 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1244/2565] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:33:48 2022] GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:48.592510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-daeea788-08da-471d-98e8-52e2f71ed4d1 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Calling method '.version_select at 0x7f387014a8b0>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:48.671310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-daeea788-08da-471d-98e8-52e2f71ed4d1 tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5" status: 202 len: 0 microversion: 2.1 time: 0.085038 Jun 29 10:33:48.672355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1322/2566] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:33:48 2022] DELETE /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:33:48.680733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aaefae54-85d7-4a6f-9a30-4dfb34c32ffd tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Calling method '.version_select at 0x7f38702f78b0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:48.731821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aaefae54-85d7-4a6f-9a30-4dfb34c32ffd tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5" status: 200 len: 353 microversion: 2.1 time: 0.054846 Jun 29 10:33:48.732413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1245/2567] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:33:48 2022] GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:48.747787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:48.748605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:48.754720 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:48.755168 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:48.755929 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:48.756363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:48.901909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:48.912234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-866b3992-842b-47b1-8b5a-349e9b077957 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.167978 Jun 29 10:33:48.913009 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1323/2568] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:48 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:49.747128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-301a6f77-d015-49c1-85c1-ae71604f855f tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Calling method '.version_select at 0x7f38702dd160>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:49.796065 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-301a6f77-d015-49c1-85c1-ae71604f855f tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] HTTP exception thrown: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-301a6f77-d015-49c1-85c1-ae71604f855f tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Request method failure captured: Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 HTTP/1.1 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCqKFgWitTN2tUrhC60_pAnsKY8UOP56PdwXET0IxASjMFhTqzHi856yXuDNPX3BRKcsSXGhlNOh1BF5ecHr3EcR8R4dw9CwfmOT0EsZJycmrZ_3Heg3yNmwrF15viSZc8ju2ZCCM2fLIydEB7cRigyScVAleWSSzF9lbBX6bJ_vYO4 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 4cf74b22676841d0b0fb7feb2c5c9c87 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesGetTestJSON-1257089917 Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:33:49.798548 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4cf74b22676841d0b0fb7feb2c5c9c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4cf74b22676841d0b0fb7feb2c5c9c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4cf74b22676841d0b0fb7feb2c5c9c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4cf74b22676841d0b0fb7feb2c5c9c87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesGetTestJSON-1257089917 Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 4cf74b22676841d0b0fb7feb2c5c9c87 Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesGetTestJSON-1257089917 Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesGetTestJSON-1257089917-project Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: c0029bc422014ff682d930ace15efd87 Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesGetTestJSON-1257089917-project Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': 'b8f6f7ae-af3d-4937-9067-d482282b36b5'} Jun 29 10:33:49.800402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. (HTTP 404) (Request-ID: req-19371b96-56ed-40ef-9c0a-e0d7f83d49b9) Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:49.801450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 10:33:49.803108 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 10:33:49.805093 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-301a6f77-d015-49c1-85c1-ae71604f855f tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] Returning 404 to user: Volume b8f6f7ae-af3d-4937-9067-d482282b36b5 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-301a6f77-d015-49c1-85c1-ae71604f855f tempest-VolumesGetTestJSON-1257089917 tempest-VolumesGetTestJSON-1257089917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5" status: 404 len: 109 microversion: 2.1 time: 0.059567 Jun 29 10:33:49.806749 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1246/2569] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 10:33:49 2022] GET /compute/v2.1/os-volumes/b8f6f7ae-af3d-4937-9067-d482282b36b5 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:33:49.934620 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:49.935979 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:49.943796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:49.944531 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:49.945289 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:49.945881 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:50.102690 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:50.110790 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bf85175d-b772-4ed6-bd92-073c30b75056 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.182551 Jun 29 10:33:50.112303 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1324/2570] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:49 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:51.131679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:51.132338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:51.138683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:51.139145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:51.139891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:51.140317 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:51.302530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:51.310316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1fe0035a-79f0-43fc-9fc2-77adf104b327 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.185435 Jun 29 10:33:51.310955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1247/2571] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:51 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:52.132892 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:52.134452 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:52.295761 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-7a8c11c4-ebaf-4fb5-ac35-bd886913f730 req-3379846a-db81-4312-bba4-4ccdc7d86f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25177d99-e25b-4526-8830-d62813053298", "name": "network-vif-plugged", "status": "completed", "tag": "80106497-356e-4e51-8624-c23c37bce622"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:52.305509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7a8c11c4-ebaf-4fb5-ac35-bd886913f730 req-3379846a-db81-4312-bba4-4ccdc7d86f4e service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:52.306258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-7a8c11c4-ebaf-4fb5-ac35-bd886913f730 req-3379846a-db81-4312-bba4-4ccdc7d86f4e service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:52.321396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-7a8c11c4-ebaf-4fb5-ac35-bd886913f730 req-3379846a-db81-4312-bba4-4ccdc7d86f4e service nova] Creating event network-vif-plugged:80106497-356e-4e51-8624-c23c37bce622 for instance 25177d99-e25b-4526-8830-d62813053298 on hv-cinder-76810 Jun 29 10:33:52.326955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:52.327662 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:52.329452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:33:52.342649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:52.343210 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:52.343879 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:52.344310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:52.348993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-7a8c11c4-ebaf-4fb5-ac35-bd886913f730 req-3379846a-db81-4312-bba4-4ccdc7d86f4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221823 Jun 29 10:33:52.349975 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1325/2572] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:33:52.532307 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:52.547077 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04fc4f5a-e0d6-419a-9207-6f65f3d087ef tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.223392 Jun 29 10:33:52.548432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1248/2573] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:52 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:33:53.569571 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:53.570714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:53.580063 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:53.580867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:53.581841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:53.582279 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:53.727272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:53.735467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c63ec50c-a332-4924-80ac-abe82371e934 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1318 microversion: 2.1 time: 0.173735 Jun 29 10:33:53.736043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1326/2574] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:53 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:54.753483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:33:54.754125 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:54.761118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:54.761542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:54.762330 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:54.762800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:54.903943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:33:54.912647 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-995d5742-9510-4422-bce2-cabdf7f36dee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1506 microversion: 2.1 time: 0.163693 Jun 29 10:33:54.913218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1249/2575] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:33:54 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:33:54.929237 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8153b3d3-7bdc-479b-ba7b-3084e0554d93", "device": "/dev/sdb"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:33:54.930940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:33:54.938207 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:54.938695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:54.939466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:33:54.939894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:33:55.209996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5d7383fd-3ff9-4797-b93b-1e80b8742da7 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "POST /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284639 Jun 29 10:33:55.211157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1327/2576] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:33:54 2022] POST /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:34:14.727570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:34:14.729012 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:34:14.731594 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=20 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:34:14.732689 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=44 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:34:14.739644 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:14.740064 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:14.740856 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:14.741316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:14.833520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'services' on Instance uuid 25177d99-e25b-4526-8830-d62813053298 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:34:14.921505 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c00eaf70-470d-4662-832e-6782daf1eed6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298/os-volume_attachments/8153b3d3-7bdc-479b-ba7b-3084e0554d93" status: 202 len: 0 microversion: 2.1 time: 0.197693 Jun 29 10:34:14.922249 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1250/2577] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:34:14 2022] DELETE /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298/os-volume_attachments/8153b3d3-7bdc-479b-ba7b-3084e0554d93 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:34:16.054135 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:34:16.055427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:34:16.061952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:34:16.062894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:34:16.073932 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:16.074535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:16.075742 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:16.076524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:16.108250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:34:16.218715 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5db32bee-f2cd-4f04-9707-184bab623981 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 204 len: 0 microversion: 2.1 time: 0.165753 Jun 29 10:34:16.222732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1328/2578] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:34:16 2022] DELETE /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:34:16.231748 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:34:16.232497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:34:16.239592 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:16.240032 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:16.240798 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:16.241264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:16.395899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:34:16.404974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-91b68f41-54c8-4068-a222-3fd088bfc540 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1512 microversion: 2.1 time: 0.180539 Jun 29 10:34:16.405517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1251/2579] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:34:16 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:34:17.423568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:34:17.424327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:34:17.433828 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:17.434275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:17.435082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:17.435637 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:17.596861 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:34:17.608926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-751632b4-10f5-4923-92b8-7aff9f1b20c9 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1512 microversion: 2.1 time: 0.189656 Jun 29 10:34:17.609831 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1329/2580] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:34:17 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:34:18.423113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-8b95fbbf-91b8-4c53-b18a-2bb5f3bd53be req-9d4f8691-9636-4462-ba21-fec0ab4024a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25177d99-e25b-4526-8830-d62813053298", "name": "network-vif-deleted", "tag": "80106497-356e-4e51-8624-c23c37bce622"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:34:18.432732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-8b95fbbf-91b8-4c53-b18a-2bb5f3bd53be req-9d4f8691-9636-4462-ba21-fec0ab4024a6 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:18.433200 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-8b95fbbf-91b8-4c53-b18a-2bb5f3bd53be req-9d4f8691-9636-4462-ba21-fec0ab4024a6 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:18.445984 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-8b95fbbf-91b8-4c53-b18a-2bb5f3bd53be req-9d4f8691-9636-4462-ba21-fec0ab4024a6 service nova] Creating event network-vif-deleted:80106497-356e-4e51-8624-c23c37bce622 for instance 25177d99-e25b-4526-8830-d62813053298 on hv-cinder-76810 Jun 29 10:34:18.452669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-8b95fbbf-91b8-4c53-b18a-2bb5f3bd53be req-9d4f8691-9636-4462-ba21-fec0ab4024a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Jun 29 10:34:18.453312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1252/2581] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:34:18.633164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:34:18.633716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:34:18.641661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:18.642119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:18.643268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:18.643777 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:18.680093 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:18.680544 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:18.681155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lazy-loading 'fault' on Instance uuid 25177d99-e25b-4526-8830-d62813053298 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:34:18.735988 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43964a0e6b48487bb90c5356d312b60d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4779579fbd6f42dcb6ad98e752ef741c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:34:18.745947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-87d4be70-e1c7-4c44-9a6a-aeebbe6d0bee tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 200 len: 1308 microversion: 2.1 time: 0.118720 Jun 29 10:34:18.747074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1330/2582] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:34:18 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:34:19.766790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:34:19.767624 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] [instance: 25177d99-e25b-4526-8830-d62813053298] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:34:19.775007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:19.775468 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:19.776408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:34:19.776852 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:34:19.794162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] HTTP exception thrown: Instance 25177d99-e25b-4526-8830-d62813053298 could not be found. Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Request method failure captured: Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 HTTP/1.1 Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCMMfbt4R6J4iaRBPLUQ2B1GmxIcvzHC-37Hv4VZiU756yoCgqTIkRMeu3EvdEN-gZUpjDwOkVLIpXmuLC_Nvv-RNjLlXRdnGUrGRohlXdIeiZ9eBC79mk_UinHdj6TodBL6WdLSWm9W9lmwx6O31qRv832BSmFsWHOVFqWfisG3ayo Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:34:19.795987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4779579fbd6f42dcb6ad98e752ef741c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 4779579fbd6f42dcb6ad98e752ef741c Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668997183 Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 43964a0e6b48487bb90c5356d312b60d Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesSnapshotTestJSON-668997183-project Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 25177d99-e25b-4526-8830-d62813053298 could not be found. Jun 29 10:34:19.798030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '25177d99-e25b-4526-8830-d62813053298'} Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25177d99-e25b-4526-8830-d62813053298 could not be found. Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:34:19.802131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25177d99-e25b-4526-8830-d62813053298 could not be found. Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25177d99-e25b-4526-8830-d62813053298 could not be found. Jun 29 10:34:19.804216 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:34:19.805850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] Returning 404 to user: Instance 25177d99-e25b-4526-8830-d62813053298 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:34:19.805850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d4db8406-1540-4683-9f57-59adbe571ec6 tempest-VolumesSnapshotTestJSON-668997183 tempest-VolumesSnapshotTestJSON-668997183-project] 10.222.0.52 "GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298" status: 404 len: 111 microversion: 2.1 time: 0.036644 Jun 29 10:34:19.805850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1253/2583] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:34:19 2022] GET /compute/v2.1/servers/25177d99-e25b-4526-8830-d62813053298 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:35:00.094261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:00.096665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:00.348311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f8a1f0d8-6c69-4a7a-9307-ca2902c15835 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Action: 'create', calling method: .version_select at 0x7f387037dd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-390377659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlz9o7qMmOW/XtwUzNW47j24JmsjQnZ7SKbDUsDIUFqxXUuqScQFrCdzFh0lRrsWHzWPk3KyKllIVTxK6ZfZL9z7gP9aNq3487E0DgpqWo7XWcUEB5PpxRbblnHhx6zfA=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:35:00.368259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-f8a1f0d8-6c69-4a7a-9307-ca2902c15835 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Getting quotas for project b73bddd1e4434ae6980546b225f2b341. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:35:00.376062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-f8a1f0d8-6c69-4a7a-9307-ca2902c15835 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Getting quotas for user dd9cb5379e6148c9b283fb26fc578c75 and project b73bddd1e4434ae6980546b225f2b341. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:35:00.406504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f8a1f0d8-6c69-4a7a-9307-ca2902c15835 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.321298 Jun 29 10:35:00.407540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1331/2584] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:35:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:35:17.940474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1067577480", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-390377659", "security_groups": [{"name": "tempest-secgroup-smoke-491555955"}], "networks": [{"uuid": "b2e1b247-f39f-4b3a-828e-9709d0da1f05"}], "block_device_mapping_v2": [{"uuid": "e7dbf713-effd-40ea-a191-10202744dffb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:35:17.956066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:17.956825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:18.295553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] validate_networks() for [('b2e1b247-f39f-4b3a-828e-9709d0da1f05', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:35:18.813274 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:35:18.813703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:35:18.814177 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:35:18.814596 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:35:18.815052 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:35:18.824712 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:18.825156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:18.825955 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:18.826388 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:18.843669 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Getting quotas for project b73bddd1e4434ae6980546b225f2b341. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:35:18.847906 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Getting quotas for user dd9cb5379e6148c9b283fb26fc578c75 and project b73bddd1e4434ae6980546b225f2b341. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:35:18.905695 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:35:18.907992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7dbf713-effd-40ea-a191-10202744dffb',volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:35:19.052821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-40be0514-27e1-447c-a6f8-04b68c0cbdf4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.116092 Jun 29 10:35:19.053421 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1254/2585] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:35:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:35:19.062728 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:19.063849 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:19.068506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8fd665f6-82b1-4ea6-8024-9ed59d58cd27 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:19.069119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8fd665f6-82b1-4ea6-8024-9ed59d58cd27 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:19.195650 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8fd665f6-82b1-4ea6-8024-9ed59d58cd27 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:19.203417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8fd665f6-82b1-4ea6-8024-9ed59d58cd27 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1088 microversion: 2.1 time: 0.142526 Jun 29 10:35:19.203995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1332/2586] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:19 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1088 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:20.220866 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71a76e67-bcc4-4539-9a96-70b9d25735c5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:20.221589 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71a76e67-bcc4-4539-9a96-70b9d25735c5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:20.288311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71a76e67-bcc4-4539-9a96-70b9d25735c5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:20.297405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71a76e67-bcc4-4539-9a96-70b9d25735c5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1088 microversion: 2.1 time: 0.080611 Jun 29 10:35:20.297973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1255/2587] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:20 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:21.314670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c014ec4f-329d-4a47-8d7c-62780f7a7e26 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:21.315337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c014ec4f-329d-4a47-8d7c-62780f7a7e26 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:21.638076 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c014ec4f-329d-4a47-8d7c-62780f7a7e26 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:21.645178 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c014ec4f-329d-4a47-8d7c-62780f7a7e26 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1088 microversion: 2.1 time: 0.334506 Jun 29 10:35:21.645749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1333/2588] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:21 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1088 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:22.663946 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:22.664554 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:22.674089 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:22.674529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:22.675337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:22.675785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:22.771102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:22.779949 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4b23fcf5-b99d-4e98-91be-e2b7750cdcfc tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1138 microversion: 2.1 time: 0.119956 Jun 29 10:35:22.780688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1256/2589] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:22 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1138 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:23.799642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:23.800465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:23.808019 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:23.808468 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:23.809299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:23.809768 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:23.880132 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:23.888258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6e882679-2f19-4f62-a557-ace1f6cf4a6f tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1186 microversion: 2.1 time: 0.093900 Jun 29 10:35:23.890157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1334/2590] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:23 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:24.908738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:24.910802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:24.921293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:24.921431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:24.922787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:24.923553 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:25.122777 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:25.134331 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e9495c30-962e-4b94-a266-472df0384b81 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.231783 Jun 29 10:35:25.135620 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1257/2591] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:24 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:25.733754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-e60819bf-e853-4fb0-808a-9fb06eff6bb0 req-66bef460-9994-4b04-b920-0a5d74608505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:35:25.750211 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e60819bf-e853-4fb0-808a-9fb06eff6bb0 req-66bef460-9994-4b04-b920-0a5d74608505 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:25.751053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e60819bf-e853-4fb0-808a-9fb06eff6bb0 req-66bef460-9994-4b04-b920-0a5d74608505 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:25.772444 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-e60819bf-e853-4fb0-808a-9fb06eff6bb0 req-66bef460-9994-4b04-b920-0a5d74608505 service nova] Creating event network-changed:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:35:25.778740 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-e60819bf-e853-4fb0-808a-9fb06eff6bb0 req-66bef460-9994-4b04-b920-0a5d74608505 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050130 Jun 29 10:35:25.779977 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1335/2592] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:35:26.155593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:26.156128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:26.163370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:26.163812 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:26.164617 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:26.165054 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:26.323079 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:26.332091 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0b68df70-ae4b-47f2-998f-fb64187157bd tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.180501 Jun 29 10:35:26.332659 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1258/2593] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:26 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:27.350842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:27.351471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:27.358334 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:27.358821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:27.359611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:27.360051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:27.508038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:27.516306 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a77b74fa-297a-4c48-97ea-14c582e8f866 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.170325 Jun 29 10:35:27.516950 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1336/2594] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:27 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:28.538555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:28.539667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:28.547924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:28.548374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:28.549247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:28.549744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:28.700618 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:28.708691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-71c851f9-8828-41eb-b967-4c6ad2aaeb85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.177354 Jun 29 10:35:28.709267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1259/2595] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:28 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:29.727510 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:29.728162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:29.735927 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:29.736420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:29.737287 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:29.737750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:29.913120 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:29.930100 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-476ee58f-138f-4efd-ba2f-399287a68026 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.206676 Jun 29 10:35:29.930894 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1337/2596] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:29 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:30.950935 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:30.951629 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:30.953642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:30.954978 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=8 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:30.961082 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:30.961529 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:30.962322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:30.962794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:31.119133 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:31.127828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-776c560d-3188-4c9e-a304-6482f560de0a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.183146 Jun 29 10:35:31.128410 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1260/2597] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:30 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:35:32.146145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:32.146821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:32.149628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:35:32.156796 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:32.157234 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:32.157998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:32.158437 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:32.313048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:32.321128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-5a15eaf9-499c-41b5-830c-20c61674673e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.179362 Jun 29 10:35:32.321710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1338/2598] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:32 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:33.339155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:33.339674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:33.347073 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:33.347545 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:33.348313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:33.348758 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:33.498170 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:33.506319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f3a792a8-0970-4d21-95b4-c54eb936b1c6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.171220 Jun 29 10:35:33.506973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1261/2599] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:33 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:34.523877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:34.524466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:34.532196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:34.532641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:34.533423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:34.533852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:34.685017 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:34.693558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9add88f-3940-48ac-90c6-1c2d7bd6c2ad tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.173546 Jun 29 10:35:34.694103 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1339/2600] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:34 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:35.711598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:35.712207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:35.720155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:35.720603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:35.721380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:35.721816 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:35.875898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:35.884791 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0e9200f7-3d1e-4a2b-9818-bd09a31f9afa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.178295 Jun 29 10:35:35.885667 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1262/2601] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:35 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:36.667092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-da75285f-0bb3-442b-ad65-d81cb690beb0 req-53bd5d56-55ad-4f64-892e-d83154772ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "name": "network-vif-plugged", "status": "completed", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:35:36.678381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-da75285f-0bb3-442b-ad65-d81cb690beb0 req-53bd5d56-55ad-4f64-892e-d83154772ff0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:36.678990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-da75285f-0bb3-442b-ad65-d81cb690beb0 req-53bd5d56-55ad-4f64-892e-d83154772ff0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:36.694887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-da75285f-0bb3-442b-ad65-d81cb690beb0 req-53bd5d56-55ad-4f64-892e-d83154772ff0 service nova] Creating event network-vif-plugged:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:35:36.701148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-da75285f-0bb3-442b-ad65-d81cb690beb0 req-53bd5d56-55ad-4f64-892e-d83154772ff0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037264 Jun 29 10:35:36.702124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1340/2602] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:35:36.903464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:36.904072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:36.911885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:36.912573 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:36.913398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:36.913818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:37.069839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:37.078221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a5d56bcb-958c-466d-a14a-fb03abd3fb4e tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1259 microversion: 2.1 time: 0.178579 Jun 29 10:35:37.078875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1263/2603] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:36 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:38.098960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:38.099666 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:38.106273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:38.106722 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:38.107529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:38.107956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:38.422512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:38.430818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7e3836fb-15c4-4e66-a936-8b2f165ffef3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1443 microversion: 2.1 time: 0.336703 Jun 29 10:35:38.431759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1341/2604] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:38 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1443 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:38.448180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:38.448793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:38.456486 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:38.456945 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:38.458110 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:38.458843 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:38.608104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:35:38.616724 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e4e316cd-d832-411e-9d6d-6fce62791614 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1443 microversion: 2.1 time: 0.172453 Jun 29 10:35:38.617392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1264/2605] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:38 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:35:40.117617 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:40.118200 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:40.125233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.125465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.126435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.126928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.143423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 HTTP/1.1 Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:35:40.145141 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.146604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '76483279-456b-4e8e-ad98-55f107a9d8f5'} Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:35:40.147372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.148613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.149871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:35:40.149871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e85d1c44-9a67-4267-b94a-9f0451a8ae33 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 404 len: 111 microversion: 2.1 time: 0.033123 Jun 29 10:35:40.149871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1342/2606] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:35:40 2022] DELETE /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:35:40.155261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:40.156472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 76483279-456b-4e8e-ad98-55f107a9d8f5] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:40.163626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.164072 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.164837 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.165262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.182078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 HTTP/1.1 Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:35:40.183874 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.185144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '76483279-456b-4e8e-ad98-55f107a9d8f5'} Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:35:40.185848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. Jun 29 10:35:40.189419 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.190449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 76483279-456b-4e8e-ad98-55f107a9d8f5 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:35:40.190449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c4a1cbe3-e0f6-49fc-8cdb-7648ba1e110b tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5" status: 404 len: 111 microversion: 2.1 time: 0.033945 Jun 29 10:35:40.190449 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1265/2607] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:40 2022] GET /compute/v2.1/servers/76483279-456b-4e8e-ad98-55f107a9d8f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:35:40.194270 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:40.194793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:40.202326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.203507 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.204281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.204718 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.223351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 HTTP/1.1 Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:35:40.224930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.230621 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '891fa3e1-cc41-4a26-955e-f0f39c734140'} Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:35:40.231661 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.232653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.233635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:35:40.233635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-32e3e807-2001-4d10-be2d-a7d3f873405e tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 404 len: 111 microversion: 2.1 time: 0.036226 Jun 29 10:35:40.233635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1343/2608] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:35:40 2022] DELETE /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:35:40.241540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:40.244983 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 891fa3e1-cc41-4a26-955e-f0f39c734140] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:40.255441 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.255952 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.256805 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.257296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.272847 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 HTTP/1.1 Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:35:40.274417 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.276105 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '891fa3e1-cc41-4a26-955e-f0f39c734140'} Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:35:40.276990 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. Jun 29 10:35:40.277999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:40.279628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 891fa3e1-cc41-4a26-955e-f0f39c734140 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:35:40.279628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1936781e-c311-4579-be5c-8b40497d0946 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140" status: 404 len: 111 microversion: 2.1 time: 0.042210 Jun 29 10:35:40.279628 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1266/2609] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:40 2022] GET /compute/v2.1/servers/891fa3e1-cc41-4a26-955e-f0f39c734140 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:35:40.480408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-0520d574-7c6d-45cb-9ebb-e814450395d0 req-36d3d362-f903-4b57-bea6-f14e413f769d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:35:40.489313 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-0520d574-7c6d-45cb-9ebb-e814450395d0 req-36d3d362-f903-4b57-bea6-f14e413f769d service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:40.489750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-0520d574-7c6d-45cb-9ebb-e814450395d0 req-36d3d362-f903-4b57-bea6-f14e413f769d service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:40.501938 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-0520d574-7c6d-45cb-9ebb-e814450395d0 req-36d3d362-f903-4b57-bea6-f14e413f769d service nova] Creating event network-changed:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:35:40.507092 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-0520d574-7c6d-45cb-9ebb-e814450395d0 req-36d3d362-f903-4b57-bea6-f14e413f769d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030473 Jun 29 10:35:40.507846 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1344/2610] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:35:41.450896 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:41.451476 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:41.458930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:41.459381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:41.460155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:41.460590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:41.475897 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c HTTP/1.1 Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:35:41.477455 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.478747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '1ddf1295-57be-4e50-8403-e2ed8353c18c'} Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:35:41.479415 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.480465 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.481546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:35:41.481546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b6836a47-552a-4d2e-84e7-b89ca68b4e1c tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 404 len: 111 microversion: 2.1 time: 0.031951 Jun 29 10:35:41.481546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1267/2611] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:35:41 2022] DELETE /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:35:41.489219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:35:41.490228 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] [instance: 1ddf1295-57be-4e50-8403-e2ed8353c18c] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:35:41.497528 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:41.497984 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:41.498817 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:35:41.499391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:35:41.515002 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] HTTP exception thrown: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Request method failure captured: Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c HTTP/1.1 Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJETWUXRp0l2it7HFEpd9U1_Oy7cyjkgRdzNNHYmD2gXuzrbu9s-eXqXaFDETZ-wK1HtJK-Ewt-ANghBOq4Er_JuDXwZbO7KhPPUSkOPh3yumkUvYkOxza7Y5j2omLre6mYoW7zyZnpFb2tNKdNC-fh42fF59uzqjVIQVAe-SvoEwk Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:35:41.516651 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/702000a5942b41689821164e169520d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/702000a5942b41689821164e169520d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_702000a5942b41689821164e169520d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 702000a5942b41689821164e169520d8 Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1553076754 Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 229771b215b3492abc2c5ec38ff0d929 Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeNegativeTest-1553076754-project Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.518787 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '1ddf1295-57be-4e50-8403-e2ed8353c18c'} Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:35:41.519569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. Jun 29 10:35:41.520792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:35:41.521933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] Returning 404 to user: Instance 1ddf1295-57be-4e50-8403-e2ed8353c18c could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:35:41.521933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7802c3b6-63ca-41db-a117-85fba7fbba46 tempest-AttachVolumeNegativeTest-1553076754 tempest-AttachVolumeNegativeTest-1553076754-project] 10.222.0.52 "GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c" status: 404 len: 111 microversion: 2.1 time: 0.033920 Jun 29 10:35:41.521933 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1345/2612] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:35:41 2022] GET /compute/v2.1/servers/1ddf1295-57be-4e50-8403-e2ed8353c18c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:36:36.170555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-745469077", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:36:36.178155 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:36.178817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=62 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:36.230729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] validate_networks() for None {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:36:36.331515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:36:36.331515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Jun 29 10:36:36.561972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:36:36.562385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:36:36.562884 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:36:36.563429 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:36:36.564112 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:36:36.575839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:36.576305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:36.577162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:36.577642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:36.598687 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Getting quotas for project 556b0713c53744e1a58fed0756ac3a13. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:36:36.603790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Getting quotas for user 79681dafdc8546c2b641e10026360fee and project 556b0713c53744e1a58fed0756ac3a13. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:36:36.615747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:36:36.617893 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:36:36.678525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fa26cc0d-9dac-4a11-a7fb-4777d31d23b5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512027 Jun 29 10:36:36.679682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1268/2613] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:36:36.694886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dbb10d93-3e5e-408f-9ad1-f01558641541 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:36.696465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dbb10d93-3e5e-408f-9ad1-f01558641541 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:36.699014 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=32 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:36.699760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=48 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:36.767559 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dbb10d93-3e5e-408f-9ad1-f01558641541 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:36.776286 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dbb10d93-3e5e-408f-9ad1-f01558641541 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1214 microversion: 2.1 time: 0.088666 Jun 29 10:36:36.776867 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1346/2614] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:36 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:37.796207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:37.796864 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:37.803558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:37.804008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:37.804811 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:37.805239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:37.880915 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:37.892490 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c5912928-c7b9-4d51-b817-6b0342c16919 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1284 microversion: 2.1 time: 0.101958 Jun 29 10:36:37.893857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1269/2615] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:37 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:38.913235 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:38.913887 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:38.921873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:38.922327 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:38.923133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:38.923569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:39.164815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:39.173043 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-190b4c0a-413c-45cc-9dc6-1ad3c54fc7d7 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.264339 Jun 29 10:36:39.173784 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1347/2616] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:38 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:39.603940 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-0dad4879-5aa8-42b7-8177-bbf1366f77c4 req-0cfcfe76-a29c-452e-b275-c738be759453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf928549-38f5-4ea8-ba4a-572507cd2b4b", "tag": "9fb60b6d-17d4-48f6-9e4c-d375f5e4fec5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:36:39.619851 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0dad4879-5aa8-42b7-8177-bbf1366f77c4 req-0cfcfe76-a29c-452e-b275-c738be759453 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:39.620341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-0dad4879-5aa8-42b7-8177-bbf1366f77c4 req-0cfcfe76-a29c-452e-b275-c738be759453 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:39.632776 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-0dad4879-5aa8-42b7-8177-bbf1366f77c4 req-0cfcfe76-a29c-452e-b275-c738be759453 service nova] Creating event network-changed:9fb60b6d-17d4-48f6-9e4c-d375f5e4fec5 for instance cf928549-38f5-4ea8-ba4a-572507cd2b4b on hv-cinder-76810 Jun 29 10:36:39.640379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-0dad4879-5aa8-42b7-8177-bbf1366f77c4 req-0cfcfe76-a29c-452e-b275-c738be759453 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043772 Jun 29 10:36:39.641958 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1270/2617] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:36:40.192003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:40.192724 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:40.199535 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:40.199982 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:40.200745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:40.201170 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:40.356520 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:40.365147 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-042002ac-0b0b-4f0d-b29d-fc98b477d3e5 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.177367 Jun 29 10:36:40.365750 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1348/2618] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:40 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:41.386818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:41.388020 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:41.398870 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:41.399580 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:41.400993 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:41.401642 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:41.549019 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:41.558297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-385679b0-e3ec-43f0-ba48-c5b7626af066 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.177659 Jun 29 10:36:41.558972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1271/2619] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:41 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:42.576890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:42.577502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:42.584472 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:42.584922 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:42.585712 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:42.586148 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:42.731064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:42.743194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-11bb276d-12a3-4074-afa6-9f898c3a421c tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.169988 Jun 29 10:36:42.744071 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1349/2620] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:42 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:43.764504 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:43.765123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:43.772483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:43.772948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:43.773730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:43.774204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:43.939313 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:43.948268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-5ab60576-48b2-4a3d-815c-e2b0d722ad72 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.187571 Jun 29 10:36:43.948858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1272/2621] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:43 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:44.969615 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-e63f76b4-0142-407a-bd2d-e08711fb3e03 req-c5889d36-b30f-421e-9092-76c0420d3303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf928549-38f5-4ea8-ba4a-572507cd2b4b", "name": "network-vif-plugged", "status": "completed", "tag": "9fb60b6d-17d4-48f6-9e4c-d375f5e4fec5"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:36:44.973446 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:44.975261 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:44.986049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e63f76b4-0142-407a-bd2d-e08711fb3e03 req-c5889d36-b30f-421e-9092-76c0420d3303 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:44.986786 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e63f76b4-0142-407a-bd2d-e08711fb3e03 req-c5889d36-b30f-421e-9092-76c0420d3303 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:44.987855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:44.988566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:44.989818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:44.990546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:45.008652 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-e63f76b4-0142-407a-bd2d-e08711fb3e03 req-c5889d36-b30f-421e-9092-76c0420d3303 service nova] Creating event network-vif-plugged:9fb60b6d-17d4-48f6-9e4c-d375f5e4fec5 for instance cf928549-38f5-4ea8-ba4a-572507cd2b4b on hv-cinder-76810 Jun 29 10:36:45.018610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-e63f76b4-0142-407a-bd2d-e08711fb3e03 req-c5889d36-b30f-421e-9092-76c0420d3303 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056455 Jun 29 10:36:45.019464 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1350/2622] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:36:45.164136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:45.172730 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d74bdbeb-c9df-4ea1-a684-05159a757374 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.206040 Jun 29 10:36:45.173327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1273/2623] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:44 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:36:46.196491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:46.197256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:46.204391 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:46.204847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:46.205610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:46.206042 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:46.354733 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:46.364003 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3ef425c0-5fc3-4126-a591-131753cd4633 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1314 microversion: 2.1 time: 0.171909 Jun 29 10:36:46.364694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1351/2624] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:46 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:47.381655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:47.382207 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:47.384732 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:47.385405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:47.391825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:47.392272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:47.393039 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:47.393472 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:47.524278 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:47.536682 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ac66ba1f-5a30-425d-8320-8bd1a0ae8668 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1463 microversion: 2.1 time: 0.159002 Jun 29 10:36:47.537435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1274/2625] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:47 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:47.578890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:47.579393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:47.581408 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:36:47.587673 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:47.588121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:47.588886 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:47.589321 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:47.614710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:36:47.690359 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-33ef1f0c-af32-4704-9a44-a8926592760b tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 204 len: 0 microversion: 2.1 time: 0.115109 Jun 29 10:36:47.690959 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1352/2626] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:36:47 2022] DELETE /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:36:47.699793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:47.700427 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:47.706460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:47.706943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:47.707700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:47.708132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:47.854734 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:47.862751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e6c7b0fa-a3ab-4ebd-acd4-146793018081 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1469 microversion: 2.1 time: 0.167084 Jun 29 10:36:47.863518 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1275/2627] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:47 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:36:48.880719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:48.881435 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:48.889259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:48.889826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:48.891166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:48.891659 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:49.125955 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:49.136990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-040f8b0e-6906-4b0a-b7c9-7cf2f9ec01ab tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1469 microversion: 2.1 time: 0.260444 Jun 29 10:36:49.137806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1353/2628] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:48 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:50.033380 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-6c11658c-2c3c-4a15-8a7b-85e1d92e5168 req-c21b3288-3dbe-4c58-a49b-d379098e06e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf928549-38f5-4ea8-ba4a-572507cd2b4b", "name": "network-vif-deleted", "tag": "9fb60b6d-17d4-48f6-9e4c-d375f5e4fec5"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:36:50.042597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6c11658c-2c3c-4a15-8a7b-85e1d92e5168 req-c21b3288-3dbe-4c58-a49b-d379098e06e9 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:50.043140 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-6c11658c-2c3c-4a15-8a7b-85e1d92e5168 req-c21b3288-3dbe-4c58-a49b-d379098e06e9 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:50.056848 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-6c11658c-2c3c-4a15-8a7b-85e1d92e5168 req-c21b3288-3dbe-4c58-a49b-d379098e06e9 service nova] Creating event network-vif-deleted:9fb60b6d-17d4-48f6-9e4c-d375f5e4fec5 for instance cf928549-38f5-4ea8-ba4a-572507cd2b4b on hv-cinder-76810 Jun 29 10:36:50.061974 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-6c11658c-2c3c-4a15-8a7b-85e1d92e5168 req-c21b3288-3dbe-4c58-a49b-d379098e06e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229744 Jun 29 10:36:50.062823 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1276/2629] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:36:50.156324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:50.156963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:50.163905 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:50.164372 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:50.165215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:50.165649 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:50.204980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:50.205459 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:50.206121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lazy-loading 'fault' on Instance uuid cf928549-38f5-4ea8-ba4a-572507cd2b4b {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:36:50.261818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79681dafdc8546c2b641e10026360fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556b0713c53744e1a58fed0756ac3a13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:36:50.279165 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b56b8f7d-d9e4-4ac3-95be-42be6b591659 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 200 len: 1304 microversion: 2.1 time: 0.126930 Jun 29 10:36:50.280869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1354/2630] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:50 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:36:51.298800 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:36:51.299587 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] [instance: cf928549-38f5-4ea8-ba4a-572507cd2b4b] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:36:51.307149 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:51.307558 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:51.308674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:36:51.309109 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:36:51.323162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] HTTP exception thrown: Instance cf928549-38f5-4ea8-ba4a-572507cd2b4b could not be found. Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Request method failure captured: Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b HTTP/1.1 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCsy3ke8XaW4e0_xPMDIYrxFnkAv8nSjhZvU_UUcUPRHJYSOe3WW-_8-35-jPjhV1_4acEuJPwodMVnlgcuxv4_M3rI_j08jvZul9XbB_TG0uxF5L1H68caPsUci8MI-u-HoVvBvMSSmYaRPA1CdcNyQLIkIYtUkGgRfQB-UysI9lM0 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 556b0713c53744e1a58fed0756ac3a13 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-VolumesNegativeTest-940097592 Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:36:51.324842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/556b0713c53744e1a58fed0756ac3a13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/556b0713c53744e1a58fed0756ac3a13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/556b0713c53744e1a58fed0756ac3a13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_556b0713c53744e1a58fed0756ac3a13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-VolumesNegativeTest-940097592 Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 556b0713c53744e1a58fed0756ac3a13 Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-VolumesNegativeTest-940097592 Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-VolumesNegativeTest-940097592-project Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 79681dafdc8546c2b641e10026360fee Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-VolumesNegativeTest-940097592-project Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance cf928549-38f5-4ea8-ba4a-572507cd2b4b could not be found. Jun 29 10:36:51.326283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': 'cf928549-38f5-4ea8-ba4a-572507cd2b4b'} Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf928549-38f5-4ea8-ba4a-572507cd2b4b could not be found. Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:36:51.327040 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf928549-38f5-4ea8-ba4a-572507cd2b4b could not be found. Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf928549-38f5-4ea8-ba4a-572507cd2b4b could not be found. Jun 29 10:36:51.328193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:36:51.329405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] Returning 404 to user: Instance cf928549-38f5-4ea8-ba4a-572507cd2b4b could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:36:51.329405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8b2348b4-4fd0-4c48-b51b-6eb467652671 tempest-VolumesNegativeTest-940097592 tempest-VolumesNegativeTest-940097592-project] 10.222.0.52 "GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b" status: 404 len: 111 microversion: 2.1 time: 0.033074 Jun 29 10:36:51.329405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1277/2631] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:36:51 2022] GET /compute/v2.1/servers/cf928549-38f5-4ea8-ba4a-572507cd2b4b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:37:00.359495 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:37:00.360065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:37:37.881157 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:37:37.881954 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:37.884121 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:37:37.884763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:37:37.891515 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:37.891960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:37.892749 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:37.893183 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:37.920481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lazy-loading 'flavor' on Instance uuid 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:37:38.021292 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cdd2b96e-51e5-4ff7-8da1-d4754e5ae784 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "POST /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972/action" status: 202 len: 0 microversion: 2.1 time: 0.144217 Jun 29 10:37:38.022202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1355/2632] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:37:37 2022] POST /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:37:38.031008 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:38.032326 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:38.034044 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:37:38.035206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=44 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:37:38.045885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:38.046643 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:38.048139 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:38.048838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:38.195635 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:38.203649 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-59b3b061-eee0-4750-9871-27f03de7a190 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.177020 Jun 29 10:37:38.204229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1278/2633] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:38 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:39.222702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:39.223381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:39.231126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:39.231478 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:39.232257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:39.232684 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:39.386442 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:39.394771 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6177d433-373a-4b10-b9b4-f5460340d328 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.176909 Jun 29 10:37:39.395358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1356/2634] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:39 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:40.416218 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:40.416781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:40.423900 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:40.424358 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:40.425135 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:40.425566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:40.574416 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:40.582405 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-eaa791b7-a50b-41b4-8eb1-83c4aea9edfe tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.170313 Jun 29 10:37:40.583046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1279/2635] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:40 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:41.600913 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:41.601524 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:41.608381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:41.608834 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:41.609597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:41.610022 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:41.752415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:41.764465 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-22217890-8473-4479-b5f3-e235771c27ef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.167274 Jun 29 10:37:41.765341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1357/2636] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:41 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:42.788881 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:42.790031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:42.801372 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:42.802174 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:42.803655 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:42.804509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:43.222821 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:43.230968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d5b44aba-aa53-477d-a6cb-b2aed340a2ce tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.446270 Jun 29 10:37:43.231538 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1280/2637] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:42 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:44.248877 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:44.249487 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:44.256595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:44.257040 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:44.257793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:44.258225 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:44.394297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:44.402949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ba3ae79d-0e4f-4ee2-afb2-817b17f9e1c8 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.158126 Jun 29 10:37:44.403502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1358/2638] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:44 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:45.420889 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:45.421495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:45.429575 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:45.430828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:45.431885 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:45.432314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:45.572492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:45.580686 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e2b0646e-c9f3-4d37-94e3-aa7b2d14ef85 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.163672 Jun 29 10:37:45.581264 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1281/2639] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:45 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:46.597562 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:46.598142 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:46.605180 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:46.605630 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:46.606477 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:46.606962 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:46.747013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:46.755058 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-19ea887f-d972-43a4-810a-9e7704bfb0b7 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.161524 Jun 29 10:37:46.755671 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1359/2640] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:46 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:47.773085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:47.773964 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:47.781033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:47.781563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:47.782378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:47.782865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:47.943041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:47.955683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-fb7de372-82f2-45a7-89aa-01c7153fa5b5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.186333 Jun 29 10:37:47.956604 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1282/2641] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:47 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:48.172793 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:48.173341 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:48.181265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:48.181509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:48.182304 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:48.182779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:48.211708 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Going to try to terminate instance {{(pid=117950) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:37:48.321928 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-94a29ca6-72cd-4a2a-87c7-66bb3c188fd2 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 204 len: 0 microversion: 2.1 time: 0.152261 Jun 29 10:37:48.323381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1360/2642] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:37:48 2022] DELETE /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:37:48.336497 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:48.337696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:48.348752 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:48.349319 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:48.350101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:48.350530 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:48.487540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:48.495684 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e1df4427-0c61-4a47-959f-19a89f4196d3 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1507 microversion: 2.1 time: 0.166299 Jun 29 10:37:48.496272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1283/2643] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:48 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:48.977377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:48.978241 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:48.984641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:48.985091 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:48.985866 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:48.986301 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:49.147123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:49.155356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-68bfdd10-0606-49de-8263-537fa913e7c0 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.182375 Jun 29 10:37:49.155951 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1361/2644] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:48 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:49.280751 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-06f012fe-1db3-438a-bfa8-023de63be4dd req-694475be-c412-4583-9a59-fc99e76c37a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3babafc-afb4-4eae-b574-eb9f6ed15d49", "name": "network-vif-deleted", "tag": "9a0b7777-bdfd-4168-abd4-ad7018402896"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:37:49.290158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-06f012fe-1db3-438a-bfa8-023de63be4dd req-694475be-c412-4583-9a59-fc99e76c37a0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:49.290626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-06f012fe-1db3-438a-bfa8-023de63be4dd req-694475be-c412-4583-9a59-fc99e76c37a0 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:49.302378 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-06f012fe-1db3-438a-bfa8-023de63be4dd req-694475be-c412-4583-9a59-fc99e76c37a0 service nova] Creating event network-vif-deleted:9a0b7777-bdfd-4168-abd4-ad7018402896 for instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 on hv-cinder-76810 Jun 29 10:37:49.308353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-06f012fe-1db3-438a-bfa8-023de63be4dd req-694475be-c412-4583-9a59-fc99e76c37a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031447 Jun 29 10:37:49.308979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1284/2645] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:37:49.515710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:49.516330 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:49.523382 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:49.523841 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:49.524698 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:49.525179 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:49.606156 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:49.615343 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e8dd4361-f3c0-4d87-9ffd-08a08c435b00 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 200 len: 1465 microversion: 2.1 time: 0.103764 Jun 29 10:37:49.615945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1362/2646] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:49 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 1465 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:50.173426 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:50.174123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:50.181911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.182374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.183523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.184013 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.323496 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:50.331755 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2a295bc4-36c2-49c3-ad9a-5bed84addf12 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.162504 Jun 29 10:37:50.332340 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1285/2647] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:50 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:50.635377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:50.636133 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: d3babafc-afb4-4eae-b574-eb9f6ed15d49] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:50.643316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.643875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.644732 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.645243 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.661328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 could not be found. Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 HTTP/1.1 Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:37:50.663205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 could not be found. Jun 29 10:37:50.664763 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': 'd3babafc-afb4-4eae-b574-eb9f6ed15d49'} Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 could not be found. Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:37:50.665669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 could not be found. Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 could not be found. Jun 29 10:37:50.666809 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:50.667814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 404 to user: Instance d3babafc-afb4-4eae-b574-eb9f6ed15d49 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:37:50.667814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ae715e35-b4d3-4d27-9bef-c68443cf2e6f tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49" status: 404 len: 111 microversion: 2.1 time: 0.033992 Jun 29 10:37:50.667814 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1363/2648] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:50 2022] GET /compute/v2.1/servers/d3babafc-afb4-4eae-b574-eb9f6ed15d49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 10:37:50.678404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:50.678979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:50.686312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.686824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.687590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.688030 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.716801 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:37:50.818123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9874cfad-4b62-483d-836a-b1c756746060 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 204 len: 0 microversion: 2.1 time: 0.143643 Jun 29 10:37:50.818797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1286/2649] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:37:50 2022] DELETE /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:37:50.830155 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:50.831642 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:50.842625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.843413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.844745 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:50.845511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:50.999398 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:51.008657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-34c5eb8b-9664-45a8-ad10-c7c9aca1a3bc tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1521 microversion: 2.1 time: 0.185223 Jun 29 10:37:51.009506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1364/2650] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:50 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:51.350793 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:51.351506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:51.358524 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:51.359017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:51.359803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:51.360248 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:51.603167 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:51.611907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7fc0d949-999f-495e-b0df-6ed35252d8fa tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1569 microversion: 2.1 time: 0.265430 Jun 29 10:37:51.612824 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1287/2651] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:51 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:51.632830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:37:51.634024 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:51.645317 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:51.646051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:51.647405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:51.648149 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:51.788144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c8b42f9c-e23b-42b6-a33e-508abb9b16d4 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "POST /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972/action" status: 202 len: 0 microversion: 2.1 time: 0.162337 Jun 29 10:37:51.789262 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1365/2652] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:37:51 2022] POST /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:37:51.798055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:51.798890 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:51.807228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:51.808183 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:51.809280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:51.809700 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:52.029084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:52.030774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:52.040891 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:52.041953 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:52.043517 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:52.044469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:52.093348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:52.108376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a0bb1d44-fcbd-463d-9694-182dac798306 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1517 microversion: 2.1 time: 0.314391 Jun 29 10:37:52.109325 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1288/2653] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:51 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:52.119113 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-aa21fc11-34dd-4bc5-940e-0ade23bcdc13 req-eebb9a8d-7074-48ce-bd72-96e772564880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1120efe8-bc65-4df7-88b6-91c5a05e0df6", "name": "network-vif-deleted", "tag": "fb530b84-13d0-48d3-bd34-ebc3797cfd0b"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:37:52.131471 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-aa21fc11-34dd-4bc5-940e-0ade23bcdc13 req-eebb9a8d-7074-48ce-bd72-96e772564880 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:52.132562 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-aa21fc11-34dd-4bc5-940e-0ade23bcdc13 req-eebb9a8d-7074-48ce-bd72-96e772564880 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:52.147492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-aa21fc11-34dd-4bc5-940e-0ade23bcdc13 req-eebb9a8d-7074-48ce-bd72-96e772564880 service nova] Creating event network-vif-deleted:fb530b84-13d0-48d3-bd34-ebc3797cfd0b for instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 on hv-cinder-76810 Jun 29 10:37:52.156069 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-aa21fc11-34dd-4bc5-940e-0ade23bcdc13 req-eebb9a8d-7074-48ce-bd72-96e772564880 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044415 Jun 29 10:37:52.156585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1289/2654] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:37:52.167456 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ba0760d13e4bbda0650de803ef46ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c695a228acc84e93baf309bec5e489c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:52.181077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1a6ece7e-0ada-46b7-b4de-3ae91e93ff3b tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 200 len: 1479 microversion: 2.1 time: 0.157689 Jun 29 10:37:52.182347 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1366/2655] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:52 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 1479 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:53.130764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:53.130764 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:53.134498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:53.134973 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:53.135797 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:53.136550 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:53.198972 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:53.199730 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] [instance: 1120efe8-bc65-4df7-88b6-91c5a05e0df6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:53.221113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:53.221587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:53.222362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:53.222832 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:53.256446 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] HTTP exception thrown: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 could not be found. Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Request method failure captured: Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 HTTP/1.1 Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCJOWFk4kzbC_goVP2hFSYFjg2q5Mw5un7gakrjF-RH_MMN2CG3zkl_WvhWo2lWUoYCUM_1ZC719yYzoYP9MkuMPQ3KW7TdFpeJKSY9abH2al_TBwvGXMWEkLrZQ4NJic-YkFFqynFyUNHELaXO5YJKCIcuN749BsIVa4f4NOO2x0PU Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:37:53.260250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c695a228acc84e93baf309bec5e489c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c695a228acc84e93baf309bec5e489c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: c695a228acc84e93baf309bec5e489c4 Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-62640990 Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 63ba0760d13e4bbda0650de803ef46ea Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-ServerRescueNegativeTestJSON-62640990-project Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 could not be found. Jun 29 10:37:53.261694 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '1120efe8-bc65-4df7-88b6-91c5a05e0df6'} Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 could not be found. Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:37:53.262502 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 could not be found. Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 could not be found. Jun 29 10:37:53.263871 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:37:53.264872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] Returning 404 to user: Instance 1120efe8-bc65-4df7-88b6-91c5a05e0df6 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:37:53.264872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-77f45a82-f715-4a0d-af17-4b9e19bcb283 tempest-ServerRescueNegativeTestJSON-62640990 tempest-ServerRescueNegativeTestJSON-62640990-project] 10.222.0.52 "GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6" status: 404 len: 111 microversion: 2.1 time: 0.067010 Jun 29 10:37:53.264872 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1367/2656] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:53 2022] GET /compute/v2.1/servers/1120efe8-bc65-4df7-88b6-91c5a05e0df6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 10:37:53.334452 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:53.353180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-e54110d6-52d7-4ddb-82c4-68f3cc006e5a tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1519 microversion: 2.1 time: 0.230237 Jun 29 10:37:53.354121 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1290/2657] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:53 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:54.373572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:54.375054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:54.384128 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:54.385127 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:54.386139 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:54.386779 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:54.392800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:37:54.660890 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:54.670534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e9527ba4-ca60-43f9-ab97-72b2afee5b36 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1575 microversion: 2.1 time: 0.301344 Jun 29 10:37:54.671491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1368/2658] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:54 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1575 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:55.345265 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-e77c8ca9-ffe3-44f3-8bce-2bdbf6884b49 req-862620b8-e454-4190-8f20-33649410e5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "name": "network-vif-unplugged", "status": "completed", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:37:55.370000 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e77c8ca9-ffe3-44f3-8bce-2bdbf6884b49 req-862620b8-e454-4190-8f20-33649410e5c5 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:55.371660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-e77c8ca9-ffe3-44f3-8bce-2bdbf6884b49 req-862620b8-e454-4190-8f20-33649410e5c5 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:55.399992 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-e77c8ca9-ffe3-44f3-8bce-2bdbf6884b49 req-862620b8-e454-4190-8f20-33649410e5c5 service nova] Creating event network-vif-unplugged:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:37:55.410988 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-e77c8ca9-ffe3-44f3-8bce-2bdbf6884b49 req-862620b8-e454-4190-8f20-33649410e5c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070492 Jun 29 10:37:55.412303 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1291/2659] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:37:55.690775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:55.691563 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:55.699213 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:55.699717 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:55.700616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:55.701154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:55.863397 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:55.872087 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-85a22a6c-cb2a-4159-b547-d2b634788e79 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1575 microversion: 2.1 time: 0.187663 Jun 29 10:37:55.872800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1369/2660] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:55 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:56.892181 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:56.897050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:56.913868 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:56.916036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:56.916036 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:56.916239 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:57.077379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:57.088329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-a94a55d0-11b2-41ba-ad5e-8ac2d85197b3 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1575 microversion: 2.1 time: 0.201577 Jun 29 10:37:57.089422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1292/2661] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:56 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:58.110827 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:58.111423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:58.120101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:58.120609 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:58.121423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:58.121857 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:58.321529 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:58.330196 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f92d0062-d6f8-45c4-a5aa-ac3c546f6a2d tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1575 microversion: 2.1 time: 0.224696 Jun 29 10:37:58.339735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1370/2662] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:58 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:37:59.354483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:37:59.355691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:37:59.364385 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:59.364995 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:59.365972 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:37:59.366392 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:37:59.629564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:37:59.638646 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efb3af9f-b11b-441d-9d06-0c11cb4aed70 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1575 microversion: 2.1 time: 0.290504 Jun 29 10:37:59.639520 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1293/2663] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:37:59 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1575 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:00.659926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:00.663746 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:00.676792 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:00.677394 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:00.678314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:00.679097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:00.880625 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:00.890463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2158e6e6-8134-44de-a53a-748b71c307a5 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1575 microversion: 2.1 time: 0.238265 Jun 29 10:38:00.891325 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1371/2664] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:00 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:01.908347 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:01.909549 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:01.918638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:01.919078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:01.920074 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:01.920656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:02.347836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:02.353929 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:02.365229 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c97ee609-447e-409d-8f0c-b9b86f3e38b2 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1562 microversion: 2.1 time: 0.460716 Jun 29 10:38:02.367638 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1294/2665] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:01 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1562 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:38:03.512556 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-52851286-7b8e-4953-946f-a72401928b74 req-566883f1-1147-4d8c-8b90-395549675744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "name": "network-vif-plugged", "status": "completed", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:03.530611 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-52851286-7b8e-4953-946f-a72401928b74 req-566883f1-1147-4d8c-8b90-395549675744 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:03.531332 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-52851286-7b8e-4953-946f-a72401928b74 req-566883f1-1147-4d8c-8b90-395549675744 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:03.546439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-52851286-7b8e-4953-946f-a72401928b74 req-566883f1-1147-4d8c-8b90-395549675744 service nova] Creating event network-vif-plugged:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:38:03.553190 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-52851286-7b8e-4953-946f-a72401928b74 req-566883f1-1147-4d8c-8b90-395549675744 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045731 Jun 29 10:38:03.553824 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1372/2666] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:38:03.965404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3636a1c9-9b6d-4002-9130-50c7dc03ae2c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: .version_select at 0x7f38702f7e50>, body: {"keypair": {"name": "tempest-keypair-1762863770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBKeJ/Du0JW1Gx5FwBrWCOwsFQOFv5nrM7Nw6qnenGUQDHNzMEJwFuOxEBfVZfEl3JYSkgxIE9McpU+yaOEZls4r23vojk8KVyK2em9Pbb0YwRPXnk3+lePQNzdSkx13A=="}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:03.983102 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-3636a1c9-9b6d-4002-9130-50c7dc03ae2c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:38:03.990744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-3636a1c9-9b6d-4002-9130-50c7dc03ae2c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for user 066254622cf34ca282883c1a033722a4 and project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'key_pairs'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:38:04.022194 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3636a1c9-9b6d-4002-9130-50c7dc03ae2c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205545 Jun 29 10:38:04.022859 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1295/2667] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:38:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:38:05.425276 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1617176973", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57655d39-fc8e-4ec0-880b-930e771a977c"}], "security_groups": [{"name": "tempest-securitygroup--1922899968"}], "key_name": "tempest-keypair-1762863770", "user_data": "}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:05.533969 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.network.neutron [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] validate_networks() for [('57655d39-fc8e-4ec0-880b-930e771a977c', None, None, None, None, None)] {{(pid=117950) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:38:06.268778 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Flavor limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:38:06.269221 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Image limits 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:38:06.269707 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Flavor pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:38:06.270123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Image pref 0:0:0 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:38:06.270586 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.virt.hardware [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117950) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:38:06.281670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:06.282523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:06.283605 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:06.284110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:06.304806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:38:06.312816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for user 066254622cf34ca282883c1a033722a4 and project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'cores', 'instances', 'ram'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:38:06.330263 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Going to run 1 instances... {{(pid=117950) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:38:06.332987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117950) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:38:06.396427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-024d60ef-d66f-44a7-b963-fe0143d69e4b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.978231 Jun 29 10:38:06.402991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1373/2668] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:38:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:38:06.415485 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0388e830-6064-45a1-bc58-538711760234 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:06.417707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0388e830-6064-45a1-bc58-538711760234 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:06.538238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0388e830-6064-45a1-bc58-538711760234 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:06.553588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0388e830-6064-45a1-bc58-538711760234 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1238 microversion: 2.1 time: 0.146266 Jun 29 10:38:06.555997 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1296/2669] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:06 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1238 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:07.574654 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:07.576080 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:07.584504 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:07.585569 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:07.586541 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:07.587261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:07.681219 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:07.695202 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ae1f34d7-b80b-4f08-9472-cdec374dae38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1290 microversion: 2.1 time: 0.126824 Jun 29 10:38:07.696088 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1374/2670] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:07 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1290 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:38:08.721622 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:08.722595 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:08.725137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:08.731101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:08.731555 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:08.732352 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:08.732795 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:08.978227 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:08.988721 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-23c6d3d3-1797-41a5-8e74-c5b814a8ae32 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.270918 Jun 29 10:38:08.989314 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1297/2671] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:08 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:09.328194 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-e6babbaa-486b-47fe-ac4f-84250d0f01e5 req-79140766-bfc2-4c2a-ab1d-a5abdd548a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a603aa1-5bdb-4d1c-9557-50dade0cd4e8", "tag": "dcb9bd9b-8957-44e7-b349-e3a9f75295f7"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:09.343136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:09.345470 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e6babbaa-486b-47fe-ac4f-84250d0f01e5 req-79140766-bfc2-4c2a-ab1d-a5abdd548a34 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:09.346186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-e6babbaa-486b-47fe-ac4f-84250d0f01e5 req-79140766-bfc2-4c2a-ab1d-a5abdd548a34 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:09.364584 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-e6babbaa-486b-47fe-ac4f-84250d0f01e5 req-79140766-bfc2-4c2a-ab1d-a5abdd548a34 service nova] Creating event network-changed:dcb9bd9b-8957-44e7-b349-e3a9f75295f7 for instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 on hv-cinder-76810 Jun 29 10:38:09.385423 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-e6babbaa-486b-47fe-ac4f-84250d0f01e5 req-79140766-bfc2-4c2a-ab1d-a5abdd548a34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060730 Jun 29 10:38:09.386062 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1375/2672] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:38:10.006656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:10.007398 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:10.016132 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:10.016583 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:10.017488 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:10.017920 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:10.182096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:10.190598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-671aa60b-3218-4306-814f-a41aa707cf41 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.187829 Jun 29 10:38:10.191186 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1298/2673] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:10 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:11.209112 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:11.209806 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:11.217268 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:11.217719 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:11.218511 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:11.218989 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:11.364123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:11.375049 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-e47f8276-8ff9-41b3-9dc1-634c3f2ec023 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.171174 Jun 29 10:38:11.375644 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1376/2674] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:11 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:12.393876 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:12.394552 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:12.401696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:12.402144 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:12.402936 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:12.403402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:12.545379 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:12.553291 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d96de380-c7d4-4c26-a5d0-e38dc50132ab tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.163383 Jun 29 10:38:12.553907 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1299/2675] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:12 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:13.573023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:13.573726 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:13.580764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:13.581233 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:13.582000 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:13.582439 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:13.723417 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:13.731634 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-b31117bb-760c-48d4-9ecf-a9846876c9f7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.162607 Jun 29 10:38:13.732420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1377/2676] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:13 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:14.752344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:14.752943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:14.761999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:14.762436 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:14.763238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:14.763679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:14.907841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:14.915911 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2caff408-5c92-42f4-a709-689920fc2c0c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.169870 Jun 29 10:38:14.916483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1300/2677] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:14 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:15.466384 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-fa1ad9a4-296d-44a7-9de2-0d6bb9ca62c8 req-40103083-365b-4369-8d16-6c66c3cd239f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a603aa1-5bdb-4d1c-9557-50dade0cd4e8", "name": "network-vif-plugged", "status": "completed", "tag": "dcb9bd9b-8957-44e7-b349-e3a9f75295f7"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:15.475772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-fa1ad9a4-296d-44a7-9de2-0d6bb9ca62c8 req-40103083-365b-4369-8d16-6c66c3cd239f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:15.476396 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-fa1ad9a4-296d-44a7-9de2-0d6bb9ca62c8 req-40103083-365b-4369-8d16-6c66c3cd239f service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:15.492220 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-fa1ad9a4-296d-44a7-9de2-0d6bb9ca62c8 req-40103083-365b-4369-8d16-6c66c3cd239f service nova] Creating event network-vif-plugged:dcb9bd9b-8957-44e7-b349-e3a9f75295f7 for instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 on hv-cinder-76810 Jun 29 10:38:15.499249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-fa1ad9a4-296d-44a7-9de2-0d6bb9ca62c8 req-40103083-365b-4369-8d16-6c66c3cd239f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036845 Jun 29 10:38:15.499883 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1378/2678] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:38:15.937470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:15.938124 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:15.945145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:15.945680 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:15.946744 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:15.947203 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:16.088681 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:16.096582 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-51190a2f-8dfe-4c70-a9c1-dde066f69421 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.163483 Jun 29 10:38:16.097159 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1301/2679] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:15 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:17.111506 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:17.112980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:17.118606 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:17.119316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:17.127101 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:17.127555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:17.128328 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:17.128767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:17.276070 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:17.284218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-17b3bbf1-e57d-4031-b918-537d36da9e00 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1364 microversion: 2.1 time: 0.173616 Jun 29 10:38:17.284766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1379/2680] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:17 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:18.300825 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:18.301425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:18.303376 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:18.310348 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:18.310826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:18.311603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:18.312066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:18.453478 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:38:18.462408 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b3251f7b-a61a-481b-8ae8-403da7a83594 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1548 microversion: 2.1 time: 0.165485 Jun 29 10:38:18.463099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1302/2681] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:38:18 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:38:18.480095 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:18.480680 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:18.487526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:18.487974 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:18.488737 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:18.489171 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:18.570107 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-713e881e-9502-4884-954e-c20af7fecdbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094696 Jun 29 10:38:18.570825 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1380/2682] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:38:18 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:38:19.551979 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-3644ecaf-8a9d-404d-ac77-b6b5a3d4dd4f req-779415bf-fddd-4600-ad64-e0942f24f835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a603aa1-5bdb-4d1c-9557-50dade0cd4e8", "tag": "dcb9bd9b-8957-44e7-b349-e3a9f75295f7"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:19.561422 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3644ecaf-8a9d-404d-ac77-b6b5a3d4dd4f req-779415bf-fddd-4600-ad64-e0942f24f835 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:19.561836 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-3644ecaf-8a9d-404d-ac77-b6b5a3d4dd4f req-779415bf-fddd-4600-ad64-e0942f24f835 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:19.576841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-3644ecaf-8a9d-404d-ac77-b6b5a3d4dd4f req-779415bf-fddd-4600-ad64-e0942f24f835 service nova] Creating event network-changed:dcb9bd9b-8957-44e7-b349-e3a9f75295f7 for instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 on hv-cinder-76810 Jun 29 10:38:19.582324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-3644ecaf-8a9d-404d-ac77-b6b5a3d4dd4f req-779415bf-fddd-4600-ad64-e0942f24f835 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034015 Jun 29 10:38:19.583071 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1303/2683] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:38:37.870296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:38:37.870938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:38:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:38:54.599527 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=11 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:54.600265 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=58 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:54.604454 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:38:54.604948 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:54.613099 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:54.613550 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:54.614308 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:54.614791 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:54.640716 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-01a20249-fce6-49c5-bab3-75c188b118f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/ips" status: 200 len: 144 microversion: 2.1 time: 0.042779 Jun 29 10:38:54.641297 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1381/2684] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:38:54 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:38:57.053058 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=13 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:57.054157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=38 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:38:57.059145 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c1fccbf-b389-4053-9edd-20623b0b439d"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:38:57.060492 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:38:57.067865 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:57.068310 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:57.069078 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:38:57.069498 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:38:57.336484 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2bb3bccb-34f6-46fc-94e5-66c87c70622c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285050 Jun 29 10:38:57.337107 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1304/2685] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:38:57 2022] POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:39:04.893751 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-02c26a7b-1a4f-495a-b5a8-5094b7e087b3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:39:04.896311 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=2 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:39:04.896990 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=4 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:39:04.903462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-02c26a7b-1a4f-495a-b5a8-5094b7e087b3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:04.903915 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-02c26a7b-1a4f-495a-b5a8-5094b7e087b3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:04.965415 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-02c26a7b-1a4f-495a-b5a8-5094b7e087b3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Going to try to stop instance {{(pid=117950) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 10:39:05.010669 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-02c26a7b-1a4f-495a-b5a8-5094b7e087b3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action" status: 202 len: 0 microversion: 2.1 time: 0.120626 Jun 29 10:39:05.011247 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1382/2686] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:39:04 2022] POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:39:05.020910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:05.021577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:05.028469 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:05.028912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:05.029901 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:05.030523 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:05.171599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:05.180381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c80db797-bc30-4d7e-a2ac-a208f43f21b7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.164558 Jun 29 10:39:05.180926 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1305/2687] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:05 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:06.198699 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:06.199413 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:06.206392 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:06.206876 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:06.207658 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:06.208154 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:06.341048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:06.351764 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-df4ea820-408a-4b6e-aa80-66400aeb4417 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.157851 Jun 29 10:39:06.352337 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1383/2688] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:06 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:07.370252 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:07.370813 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:07.378259 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:07.378741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:07.379507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:07.379931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:07.513068 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:07.521891 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-227a427e-0ced-4e09-be76-ce8009ab8c61 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.155843 Jun 29 10:39:07.522464 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1306/2689] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:07 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:08.539926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:08.540656 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:08.547897 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:08.548361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:08.549205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:08.549655 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:08.703376 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:08.720800 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-2f6e87a2-153e-4a89-ae37-e0767c45fb3d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.184497 Jun 29 10:39:08.721451 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1384/2690] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:08 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:09.738546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:09.739461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:09.750528 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:09.751337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:09.752621 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:09.753262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:09.894219 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:09.902399 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f451f257-caa6-48b9-8267-0c0192ed060c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.168804 Jun 29 10:39:09.903005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1307/2691] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:09 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:10.923203 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:10.923826 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:10.931260 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:10.931709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:10.932469 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:10.932898 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:11.074249 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:11.082663 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-a5bc1a98-f023-4fd0-a674-cd2f5f1ab79d tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.163257 Jun 29 10:39:11.083272 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1385/2692] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:10 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:12.100489 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:12.101126 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:12.107980 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:12.108442 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:12.109220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:12.109663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:12.262598 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:12.271506 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-3a3bd499-6980-4053-87dd-32315a0cce4e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.175136 Jun 29 10:39:12.272092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1308/2693] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:12 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:13.290223 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:13.290936 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:13.297521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:13.297971 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:13.298785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:13.299218 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:13.451638 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:13.461555 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6d8946bb-68d9-4687-985f-68a80d479a13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.175462 Jun 29 10:39:13.462136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1386/2694] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:13 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 10:39:14.479312 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:14.480046 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:14.487698 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:14.488147 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:14.488925 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:14.489353 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:14.625066 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:14.633707 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b937f57d-9dd8-454e-8c40-d8f1fb0a7427 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.158954 Jun 29 10:39:14.634276 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1309/2695] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:14 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:15.650702 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:15.651320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:15.658759 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:15.659320 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:15.660096 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:15.660539 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:15.828159 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:15.836766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d3d2f77b-7a8e-4a24-8211-282db89b3dc0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.190040 Jun 29 10:39:15.837342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1387/2696] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:15 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:15.965883 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:15.966404 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:15.968257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-60c19325-792b-4afc-ba88-bf192a8c4426 req-0a8b5442-ffc6-47bd-a359-59a7fe86532c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:39:15.973477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:15.973922 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:15.974718 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:15.975157 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:15.977430 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-60c19325-792b-4afc-ba88-bf192a8c4426 req-0a8b5442-ffc6-47bd-a359-59a7fe86532c service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:15.977952 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-60c19325-792b-4afc-ba88-bf192a8c4426 req-0a8b5442-ffc6-47bd-a359-59a7fe86532c service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:15.991191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-60c19325-792b-4afc-ba88-bf192a8c4426 req-0a8b5442-ffc6-47bd-a359-59a7fe86532c service nova] Creating event network-changed:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:39:15.996371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-60c19325-792b-4afc-ba88-bf192a8c4426 req-0a8b5442-ffc6-47bd-a359-59a7fe86532c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031752 Jun 29 10:39:15.997281 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1388/2697] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:39:16.004674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:39:16.101448 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b9346505-b779-4c2a-ab77-89c634698b01 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 204 len: 0 microversion: 2.1 time: 0.138667 Jun 29 10:39:16.102381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1310/2698] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:39:15 2022] DELETE /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:39:16.111956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:16.113509 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:16.120760 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:16.121362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:16.122298 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:16.122855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:16.264521 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:16.272493 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c3a4748a-cf0b-412d-b091-aff64a9416a6 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.164703 Jun 29 10:39:16.273082 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1389/2699] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:16 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:16.854297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:16.854943 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:16.861542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:16.861999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:16.862846 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:16.863341 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:17.000332 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:17.012704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-aa154d6a-8348-4c41-a16f-3b7b20cded6a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.162671 Jun 29 10:39:17.015101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1311/2700] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:16 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:17.291084 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:17.291906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:17.300326 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:17.301206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:17.302032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:17.302467 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:17.450090 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:17.459176 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-bc675936-d023-4412-b821-4f0c92ad4c18 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1568 microversion: 2.1 time: 0.171826 Jun 29 10:39:17.459785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1390/2701] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:17 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:18.032627 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:18.033233 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:18.043055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:18.043055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:18.043055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:18.043337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:18.060895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-2569e8cd-3dc1-4c8b-9433-b7e36621ab56 req-542d016b-3bc2-4946-a17d-ce6b129d9d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3cd7b5-d0dd-457a-a04f-1695cf5f4972", "name": "network-vif-deleted", "tag": "0350ce1c-663c-4e98-8efd-e53063990e16"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:39:18.073191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-2569e8cd-3dc1-4c8b-9433-b7e36621ab56 req-542d016b-3bc2-4946-a17d-ce6b129d9d36 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:18.073782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-2569e8cd-3dc1-4c8b-9433-b7e36621ab56 req-542d016b-3bc2-4946-a17d-ce6b129d9d36 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:18.086596 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-2569e8cd-3dc1-4c8b-9433-b7e36621ab56 req-542d016b-3bc2-4946-a17d-ce6b129d9d36 service nova] Creating event network-vif-deleted:0350ce1c-663c-4e98-8efd-e53063990e16 for instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 on hv-cinder-76810 Jun 29 10:39:18.092653 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-2569e8cd-3dc1-4c8b-9433-b7e36621ab56 req-542d016b-3bc2-4946-a17d-ce6b129d9d36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035515 Jun 29 10:39:18.093540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1391/2702] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:39:18.218794 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:18.228204 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-0fc144d0-ea56-4140-8710-a8d813b44c6b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.201229 Jun 29 10:39:18.229246 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1312/2703] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:18 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:18.478363 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:18.479023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:18.487534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:18.488113 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:18.489244 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:18.489714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:18.525703 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:18.526144 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:18.526597 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lazy-loading 'fault' on Instance uuid 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:39:18.572573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9cb5379e6148c9b283fb26fc578c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73bddd1e4434ae6980546b225f2b341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:18.582110 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6cd5bb0d-28a8-4956-94b9-5012ef467b15 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 200 len: 1224 microversion: 2.1 time: 0.108761 Jun 29 10:39:18.582700 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1392/2704] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:18 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:19.246197 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:19.246858 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:19.254305 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:19.254802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:19.255588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:19.256026 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:19.394930 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:19.403473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7450d4a5-d403-4599-bf97-5539aece2f7f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1723 microversion: 2.1 time: 0.161256 Jun 29 10:39:19.404055 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1313/2705] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:19 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:19.600074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:19.600636 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] [instance: 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:19.607471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:19.607945 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:19.608709 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:19.609136 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:19.623830 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] HTTP exception thrown: Instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 could not be found. Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Request method failure captured: Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 HTTP/1.1 Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCrOKu1jPv_zSsFQu8-mIVS5T5DLXJYOcpqrGbFg1qp61X28fM2isKy-Dk21-8warZy-ObGYt6Hnm7fbhn9AxdPrF2C_Mn0zVO8Gk2_zafsk4qoSXvabH1_c6BcsgQUUAcR99kKqngV7UzGNKjhs8vOFlmjX4Z2wPS5qjMRh8YFb-jI Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: b73bddd1e4434ae6980546b225f2b341 Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-TestShelveInstance-577575702 Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:39:19.625491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b73bddd1e4434ae6980546b225f2b341"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b73bddd1e4434ae6980546b225f2b341"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b73bddd1e4434ae6980546b225f2b341"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b73bddd1e4434ae6980546b225f2b341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-TestShelveInstance-577575702 Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: b73bddd1e4434ae6980546b225f2b341 Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-TestShelveInstance-577575702 Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-TestShelveInstance-577575702-project Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: dd9cb5379e6148c9b283fb26fc578c75 Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-TestShelveInstance-577575702-project Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 could not be found. Jun 29 10:39:19.626940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '3d3cd7b5-d0dd-457a-a04f-1695cf5f4972'} Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 could not be found. Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:39:19.627693 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 could not be found. Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 could not be found. Jun 29 10:39:19.629145 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:39:19.630377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Returning 404 to user: Instance 3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:39:19.630377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c85f623d-d2af-4934-8048-35c404b29246 tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972" status: 404 len: 111 microversion: 2.1 time: 0.030970 Jun 29 10:39:19.630377 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1393/2706] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:19 2022] GET /compute/v2.1/servers/3d3cd7b5-d0dd-457a-a04f-1695cf5f4972 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:39:19.839790 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-efa0c89d-7c33-4a32-ab81-ad3b68aaccef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] Calling method '.version_select at 0x7f38701b3ca0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:19.859760 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-efa0c89d-7c33-4a32-ab81-ad3b68aaccef tempest-TestShelveInstance-577575702 tempest-TestShelveInstance-577575702-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-390377659" status: 202 len: 0 microversion: 2.1 time: 0.023796 Jun 29 10:39:19.860268 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1314/2707] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 10:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-390377659 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:39:20.421623 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:20.422508 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:20.429256 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:20.429735 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:20.430580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:20.431016 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:20.568255 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:20.577282 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-63967341-b171-49d6-80a5-959638c19079 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1700 microversion: 2.1 time: 0.159987 Jun 29 10:39:20.577855 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1394/2708] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:20 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:20.595131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2c4f2442-11b0-4db6-b065-ba344a2b9876 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:39:20.601768 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c4f2442-11b0-4db6-b065-ba344a2b9876 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:20.602221 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2c4f2442-11b0-4db6-b065-ba344a2b9876 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:20.664337 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2c4f2442-11b0-4db6-b065-ba344a2b9876 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Going to try to start instance {{(pid=117951) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 10:39:20.713096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2c4f2442-11b0-4db6-b065-ba344a2b9876 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action" status: 202 len: 0 microversion: 2.1 time: 0.122372 Jun 29 10:39:20.713910 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1315/2709] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:39:20 2022] POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:39:20.722109 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:20.722802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:20.730008 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:20.730604 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:20.731512 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:20.732074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:20.967181 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:20.979965 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-fd6a9490-d386-44b6-9d6f-fee173d901c3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1709 microversion: 2.1 time: 0.261816 Jun 29 10:39:20.980523 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1395/2710] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:20 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1709 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:22.001002 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:22.001590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:22.008234 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:22.008710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:22.009671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:22.010299 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:22.227180 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:22.236368 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9af2bbd6-2bb4-4a0f-b3dc-8ff52c2e8020 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1709 microversion: 2.1 time: 0.242032 Jun 29 10:39:22.236996 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1316/2711] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:21 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1709 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:23.256065 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:23.257056 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:23.264387 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:23.264843 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:23.265610 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:23.266047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:23.411261 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:23.419635 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1e0d2ff8-90e6-4d50-ac01-7208c94a347a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1713 microversion: 2.1 time: 0.169771 Jun 29 10:39:23.420312 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1396/2712] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:23 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:51.926741 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:51.927365 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:51.930287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:39:51.931282 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:39:51.941005 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:51.941564 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:51.942517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:51.943092 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:52.045959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.objects.instance [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lazy-loading 'services' on Instance uuid 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 {{(pid=117951) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:39:52.126344 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-06ab1e3a-e3b5-491e-8c27-b47d22079dea tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-volume_attachments/5c1fccbf-b389-4053-9edd-20623b0b439d" status: 202 len: 0 microversion: 2.1 time: 0.205477 Jun 29 10:39:52.127031 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1317/2713] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:39:51 2022] DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-volume_attachments/5c1fccbf-b389-4053-9edd-20623b0b439d => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:39:53.262483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dae7b41a-f5cc-4673-a58b-90725ac0c589 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:39:53.265126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=32 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:39:53.265775 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:39:53.271994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dae7b41a-f5cc-4673-a58b-90725ac0c589 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:53.272449 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dae7b41a-f5cc-4673-a58b-90725ac0c589 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:53.300570 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dae7b41a-f5cc-4673-a58b-90725ac0c589 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Going to try to stop instance {{(pid=117950) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 10:39:53.351259 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dae7b41a-f5cc-4673-a58b-90725ac0c589 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action" status: 202 len: 0 microversion: 2.1 time: 0.092081 Jun 29 10:39:53.352064 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1397/2714] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:39:53 2022] POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:39:53.363382 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:53.364099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:53.370774 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:53.371232 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:53.371989 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:53.372431 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:53.510018 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:53.518156 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-8954b307-a70b-4abe-b4d2-38936336a7de tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.160069 Jun 29 10:39:53.518765 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1318/2715] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:53 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:54.539483 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:54.540193 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:54.547273 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:54.547729 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:54.548498 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:54.548940 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:54.696356 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:54.706318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8677db9c-e6ff-45ea-a574-732cad1e9901 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.171707 Jun 29 10:39:54.706926 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1398/2716] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:54 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:55.730118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:55.730898 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:55.739779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:55.740366 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:55.741515 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:55.742120 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:55.896425 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:55.904951 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d1193f99-e3ad-4500-bb2d-7d75684b4527 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.180986 Jun 29 10:39:55.906146 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1319/2717] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:55 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:56.928580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:56.929489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:56.938006 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:56.938688 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:56.939458 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:56.939895 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:57.097162 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:57.105124 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-c600ab56-ec2c-4216-bc5b-18b1a4e61698 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.184239 Jun 29 10:39:57.105714 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1399/2718] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:56 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:58.123704 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:58.124950 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:58.132090 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:58.132542 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:58.133316 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:58.133747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:58.281599 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:58.291165 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4f16b82b-af8c-463c-9b34-93d3aec88ad0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.171533 Jun 29 10:39:58.292324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1320/2719] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:58 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:39:59.314471 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:39:59.315074 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:39:59.321875 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:59.322324 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:59.323248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:39:59.323682 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:39:59.468367 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:39:59.476533 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8c8ca687-be7f-4968-a7ef-cf59bf2bd9a8 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.168007 Jun 29 10:39:59.477108 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1400/2720] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:39:59 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:00.496726 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:00.497320 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:00.505633 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:00.506101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:00.506895 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:00.507322 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:00.652450 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:00.662295 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-98215415-b388-4120-bff5-9cc8fce769fc tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.169954 Jun 29 10:40:00.662916 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1321/2721] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:00 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:01.680404 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:01.681011 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:01.688884 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:01.689318 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:01.690105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:01.690532 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:01.834668 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:01.842785 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-f3341026-1121-460a-b8a6-8e98299ecf13 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.166900 Jun 29 10:40:01.843350 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1401/2722] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:01 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:02.862693 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:02.863280 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:02.872338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:02.872786 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:02.873577 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:02.874015 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:03.030502 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:03.038381 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-c45bbe8e-1f6c-4665-bc11-d280fd8609cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1677 microversion: 2.1 time: 0.181396 Jun 29 10:40:03.039214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1322/2723] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:02 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:04.056670 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:04.057035 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:04.065038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:04.065038 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:04.066371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:04.066371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:04.211206 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:04.220248 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-dd95db2e-a425-468b-9238-da2618afb693 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1654 microversion: 2.1 time: 0.168287 Jun 29 10:40:04.220967 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1402/2724] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:04 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:04.237228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-821e1f2a-eb4c-4a49-a5ea-d172b724dc54 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:04.244131 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-821e1f2a-eb4c-4a49-a5ea-d172b724dc54 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:04.244579 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-821e1f2a-eb4c-4a49-a5ea-d172b724dc54 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:04.267262 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-821e1f2a-eb4c-4a49-a5ea-d172b724dc54 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Going to try to start instance {{(pid=117951) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 10:40:04.327576 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-821e1f2a-eb4c-4a49-a5ea-d172b724dc54 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action" status: 202 len: 0 microversion: 2.1 time: 0.094278 Jun 29 10:40:04.328101 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1323/2725] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 10:40:04 2022] POST /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 10:40:04.336371 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:04.337034 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:04.343993 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:04.344753 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:04.345542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:04.346767 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:04.487526 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:04.495307 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-6ecaf880-f74e-45bc-9ad1-e34404754ae5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1663 microversion: 2.1 time: 0.162835 Jun 29 10:40:04.495873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1403/2726] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:04 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:05.513691 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:05.514357 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:05.522283 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:05.522806 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:05.523626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:05.524062 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:05.669679 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:05.677546 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-751813a2-e321-4a27-bfc9-762e7c7568b2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1667 microversion: 2.1 time: 0.168617 Jun 29 10:40:05.678473 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1324/2727] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:05 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:09.966258 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:40:09.966900 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:40:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:40:37.907931 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:37.908956 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:37.911345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=14 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:40:37.912094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:40:37.918960 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:37.919402 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:37.920166 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:37.920595 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:37.954522 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-cc38db29-96e7-47df-85fd-dcc2440a9742 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050589 Jun 29 10:40:37.955105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1404/2728] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:40:37 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 10:40:38.014509 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:38.015123 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:38.017470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=16 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:40:38.018138 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:40:38.024400 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:38.024912 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:38.028853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:38.028853 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:38.054696 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:40:38.141660 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-b4cce788-c40f-44dd-ba71-73dd80651caf tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 204 len: 0 microversion: 2.1 time: 0.130636 Jun 29 10:40:38.142507 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1325/2729] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:40:38 2022] DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:40:38.153381 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:38.154018 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:38.160457 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:38.160909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:38.161676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:38.162105 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:38.419489 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:38.427995 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d4cfd170-c465-4a99-a594-e64e1f423f64 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1673 microversion: 2.1 time: 0.279940 Jun 29 10:40:38.428574 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1405/2730] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:38 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1673 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:39.448854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:39.449571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:39.458296 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:39.458854 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:39.459703 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:39.460136 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:39.671007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:39.679603 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-903742f6-4b15-4693-983a-2d1208768f2b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1673 microversion: 2.1 time: 0.237084 Jun 29 10:40:39.680483 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1326/2731] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:39 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:40.697370 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:40.698007 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:40.705766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:40.706215 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:40.707015 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:40.707455 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:40.804816 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:40.813013 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-d02e0b7d-3b9b-4ddc-84cc-a90ee41c00d3 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 200 len: 1605 microversion: 2.1 time: 0.119468 Jun 29 10:40:40.813616 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1406/2732] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:40 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 1605 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:40.894470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-fbc42398-40f1-4ab2-83ae-d3c8a2581f63 req-8d628d3b-4230-4183-8662-b00858039716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a603aa1-5bdb-4d1c-9557-50dade0cd4e8", "name": "network-vif-deleted", "tag": "dcb9bd9b-8957-44e7-b349-e3a9f75295f7"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:40.911037 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-fbc42398-40f1-4ab2-83ae-d3c8a2581f63 req-8d628d3b-4230-4183-8662-b00858039716 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:40.911474 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-fbc42398-40f1-4ab2-83ae-d3c8a2581f63 req-8d628d3b-4230-4183-8662-b00858039716 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:40.923869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-fbc42398-40f1-4ab2-83ae-d3c8a2581f63 req-8d628d3b-4230-4183-8662-b00858039716 service nova] Creating event network-vif-deleted:dcb9bd9b-8957-44e7-b349-e3a9f75295f7 for instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 on hv-cinder-76810 Jun 29 10:40:40.930605 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-fbc42398-40f1-4ab2-83ae-d3c8a2581f63 req-8d628d3b-4230-4183-8662-b00858039716 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Jun 29 10:40:40.931626 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1327/2733] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:40:41.830996 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:41.831710 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:41.838342 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:41.838869 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:41.839628 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:41.842361 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:41.859299 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] HTTP exception thrown: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Request method failure captured: Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 HTTP/1.1 Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCuLBWT0dLf6x7aabg8fJ1EjiPo5LdGVJiAU0CjetooeFUIisw8P1vfI25_XVUW0oRJrm6nceg0CqXvYcxEZHH4CUM0F7GEMTDcj-ZIMA-14qratqvdzww_YQAHx1RerrL3xQ9N8_EG_ecVSGLHtetUp_LhEdCrFiRm0NGP2OmCQuCg Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:40:41.862580 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 066254622cf34ca282883c1a033722a4 Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:40:41.864538 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '9a603aa1-5bdb-4d1c-9557-50dade0cd4e8'} Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:40:41.865545 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:40:41.867316 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:40:41.868743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Returning 404 to user: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:40:41.868743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-ed1e975c-a86a-4baf-85f4-5a0ca928c2bd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 404 len: 111 microversion: 2.1 time: 0.035616 Jun 29 10:40:41.868743 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1407/2734] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:41 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 10:40:41.877088 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-42585947-b584-466e-8c3e-f74b75d790f5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '.version_select at 0x7f38702f7a60>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:41.897470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-42585947-b584-466e-8c3e-f74b75d790f5 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762863770" status: 202 len: 0 microversion: 2.1 time: 0.024851 Jun 29 10:40:41.898447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1328/2735] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 10:40:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1762863770 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:40:42.562695 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1b7be608-3e3b-4631-ac89-b71a726e3070 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: .version_select at 0x7f387014a4c0>, body: {"keypair": {"name": "tempest-keypair-2027707473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFzbMHF6AAkVKXN83mjuNjdH38aIqAkYEIBrd12sq7r2+i6fkm20zN/YtRKaI+JI7ghwPu8UvSQQ2kYFgGz8kjttl1g4llx8iayMdJ7t6DlRr165bQONpUlIqSR/I63ag=="}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:42.577590 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1b7be608-3e3b-4631-ac89-b71a726e3070 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:40:42.582036 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.quota [None req-1b7be608-3e3b-4631-ac89-b71a726e3070 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for user 066254622cf34ca282883c1a033722a4 and project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'key_pairs'} {{(pid=117950) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:40:42.611589 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1b7be608-3e3b-4631-ac89-b71a726e3070 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053402 Jun 29 10:40:42.612177 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1408/2736] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 10:40:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 10:40:43.975601 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-499841292", "imageRef": "87cdcdd2-fe14-4590-9e0b-d585d5b52abf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57655d39-fc8e-4ec0-880b-930e771a977c"}], "security_groups": [{"name": "tempest-securitygroup--1754372734"}], "key_name": "tempest-keypair-2027707473", "user_data": "}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:44.091160 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.network.neutron [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] validate_networks() for [('57655d39-fc8e-4ec0-880b-930e771a977c', None, None, None, None, None)] {{(pid=117951) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 10:40:44.546459 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Flavor limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 10:40:44.546987 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Image limits 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 10:40:44.547461 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Flavor pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 10:40:44.547917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Image pref 0:0:0 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 10:40:44.548324 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.virt.hardware [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117951) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 10:40:44.559057 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:44.559517 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:44.560327 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:44.560761 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:44.577838 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 10:40:44.581998 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.quota [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Getting quotas for user 066254622cf34ca282883c1a033722a4 and project 1328f3aff9a042068380feeb1e7c5f1e. Resources: {'cores', 'instances', 'ram'} {{(pid=117951) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 10:40:44.594118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Going to run 1 instances... {{(pid=117951) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 10:40:44.596563 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='87cdcdd2-fe14-4590-9e0b-d585d5b52abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117951) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 10:40:44.643938 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-04e4a192-4642-4650-812c-fe93bf9b4cbd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.673413 Jun 29 10:40:44.644593 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1329/2737] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 10:40:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 10:40:44.655769 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4e329957-a586-49b5-b8d8-9cdec95c0d72 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:44.656518 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4e329957-a586-49b5-b8d8-9cdec95c0d72 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:44.715918 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-4e329957-a586-49b5-b8d8-9cdec95c0d72 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:44.723089 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4e329957-a586-49b5-b8d8-9cdec95c0d72 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1237 microversion: 2.1 time: 0.072016 Jun 29 10:40:44.723657 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1409/2738] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:44 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:45.741050 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:45.741803 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:45.749871 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:45.750329 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:45.751153 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:45.751588 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:45.835033 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:45.844198 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-7972eddc-b123-4304-912d-fd7cc4070f7e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1297 microversion: 2.1 time: 0.106943 Jun 29 10:40:45.845367 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1330/2739] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:45 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:46.863406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:46.863980 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:46.871436 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:46.871782 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:46.872612 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:46.873051 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:47.113431 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:47.121463 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-08f45740-81ef-42b6-8029-cc8b6dd6f4f1 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1363 microversion: 2.1 time: 0.261968 Jun 29 10:40:47.122037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1410/2740] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:46 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:47.320154 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-50fd3bc8-0b80-46b1-b767-677828be4a10 req-ffdebce4-88ff-4ea8-a614-705c5bd98e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a0731c-558a-4f7a-9067-c025a9980af6", "tag": "5e6a8355-3893-4c82-a047-72a518f3273c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:47.335731 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-50fd3bc8-0b80-46b1-b767-677828be4a10 req-ffdebce4-88ff-4ea8-a614-705c5bd98e65 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:47.336842 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-50fd3bc8-0b80-46b1-b767-677828be4a10 req-ffdebce4-88ff-4ea8-a614-705c5bd98e65 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:47.351570 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-50fd3bc8-0b80-46b1-b767-677828be4a10 req-ffdebce4-88ff-4ea8-a614-705c5bd98e65 service nova] Creating event network-changed:5e6a8355-3893-4c82-a047-72a518f3273c for instance 35a0731c-558a-4f7a-9067-c025a9980af6 on hv-cinder-76810 Jun 29 10:40:47.360470 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-50fd3bc8-0b80-46b1-b767-677828be4a10 req-ffdebce4-88ff-4ea8-a614-705c5bd98e65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045604 Jun 29 10:40:47.361201 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1331/2741] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:40:48.139548 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:48.140137 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:48.147191 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:48.147641 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:48.148399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:48.148835 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:48.282383 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:48.290086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-44bd1029-a1bd-43e3-b157-f03da026ac8e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1363 microversion: 2.1 time: 0.154876 Jun 29 10:40:48.290676 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1411/2742] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:48 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:49.308787 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:49.309462 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:49.316047 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:49.316525 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:49.317272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:49.317719 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:49.453137 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:49.460733 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-974dbfd3-8d43-4700-89ab-afd8ce9ffb42 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1363 microversion: 2.1 time: 0.156801 Jun 29 10:40:49.461297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1332/2743] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:49 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:50.478054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:50.479048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:50.486847 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:50.487293 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:50.488054 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:50.488479 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:50.640627 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:50.648420 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-9daf877f-f9db-451c-ae2d-4a04482ec1d9 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1363 microversion: 2.1 time: 0.174328 Jun 29 10:40:50.649053 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1412/2744] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:50 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:51.666104 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:51.666756 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:51.674256 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:51.674729 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:51.675495 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:51.675924 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:51.810948 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:51.822503 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d1680613-98cf-4797-a96e-74de7377f64f tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1363 microversion: 2.1 time: 0.160182 Jun 29 10:40:51.823118 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1333/2745] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:51 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:52.362406 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-5f1a5b8e-b1f4-4a02-9d87-9e0a75042993 req-b2e41c9c-de22-429b-ab70-428b18851681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a0731c-558a-4f7a-9067-c025a9980af6", "name": "network-vif-plugged", "status": "completed", "tag": "5e6a8355-3893-4c82-a047-72a518f3273c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:52.371462 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-5f1a5b8e-b1f4-4a02-9d87-9e0a75042993 req-b2e41c9c-de22-429b-ab70-428b18851681 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:52.372564 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-5f1a5b8e-b1f4-4a02-9d87-9e0a75042993 req-b2e41c9c-de22-429b-ab70-428b18851681 service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:52.384393 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-5f1a5b8e-b1f4-4a02-9d87-9e0a75042993 req-b2e41c9c-de22-429b-ab70-428b18851681 service nova] Creating event network-vif-plugged:5e6a8355-3893-4c82-a047-72a518f3273c for instance 35a0731c-558a-4f7a-9067-c025a9980af6 on hv-cinder-76810 Jun 29 10:40:52.389964 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-5f1a5b8e-b1f4-4a02-9d87-9e0a75042993 req-b2e41c9c-de22-429b-ab70-428b18851681 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097801 Jun 29 10:40:52.391086 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1413/2746] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:40:52.843841 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:52.844402 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:52.851142 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:52.851590 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:52.852355 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:52.852779 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:53.264826 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:53.272338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae829cf0-866e-4173-8190-13486569f1e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1363 microversion: 2.1 time: 0.433739 Jun 29 10:40:53.272899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1334/2747] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:52 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:54.291250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:54.291917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:54.298795 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:54.299257 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:54.300023 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:54.300466 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:54.443575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:40:54.452271 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-7794131f-8852-45fb-8665-ef5dcf856c50 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1548 microversion: 2.1 time: 0.165954 Jun 29 10:40:54.452851 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1414/2748] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:40:54 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:40:54.468799 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:40:54.469338 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:40:54.476351 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:54.476804 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:54.477571 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:54.478007 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:54.557976 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-1e7691f3-7077-4d7c-8dfb-97e5e45476fd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093138 Jun 29 10:40:54.558585 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1335/2749] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 10:40:54 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:40:55.570780 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell0:SELECT=6 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:40:55.628319 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [req-9cb54127-273a-4cf9-9232-8f62c7d9e871 req-ee66a014-4b27-4937-ade3-088f8d3e0fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a0731c-558a-4f7a-9067-c025a9980af6", "tag": "5e6a8355-3893-4c82-a047-72a518f3273c"}]} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:40:55.636587 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-9cb54127-273a-4cf9-9232-8f62c7d9e871 req-ee66a014-4b27-4937-ade3-088f8d3e0fff service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:40:55.637004 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [req-9cb54127-273a-4cf9-9232-8f62c7d9e871 req-ee66a014-4b27-4937-ade3-088f8d3e0fff service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:40:55.649160 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.compute.server_external_events [req-9cb54127-273a-4cf9-9232-8f62c7d9e871 req-ee66a014-4b27-4937-ade3-088f8d3e0fff service nova] Creating event network-changed:5e6a8355-3893-4c82-a047-72a518f3273c for instance 35a0731c-558a-4f7a-9067-c025a9980af6 on hv-cinder-76810 Jun 29 10:40:55.654815 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [req-9cb54127-273a-4cf9-9232-8f62c7d9e871 req-ee66a014-4b27-4937-ade3-088f8d3e0fff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088381 Jun 29 10:40:55.655412 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1415/2750] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:31.759211 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=2 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:41:31.760009 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell0:SELECT=6 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:41:31.762025 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:41:31.762738 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG dbcounter [-] [117951] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117951) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:41:31.767835 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:31.768414 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:31.778011 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:31.778460 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:31.779267 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:31.779713 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:31.807810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-4d82ff83-a941-4db8-876f-6b8c8094925a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/ips" status: 200 len: 145 microversion: 2.1 time: 0.049163 Jun 29 10:41:31.808591 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1336/2751] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 10:41:31 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:33.165351 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:41:33.166158 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG dbcounter [-] [117950] Writing DB stats nova_cell1:SELECT=48 {{(pid=117950) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 10:41:33.171152 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58254526-688a-4731-9604-3d634924b4b7"}} {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:41:33.172542 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:33.180491 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:33.181123 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:33.181930 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:33.182374 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:33.442209 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-1dabc842-b027-468d-ad07-a82e46f1dc02 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278280 Jun 29 10:41:33.443032 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1416/2752] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:41:33 2022] POST /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:39.936022 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:39.936971 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:39.944220 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:39.944671 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:39.945440 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:39.945869 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:39.978540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-d075c27b-d289-4c79-887d-31c9819cc2cd tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047099 Jun 29 10:41:39.979287 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1337/2753] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:41:39 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:39.990949 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:39.991560 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:39.998978 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:39.999427 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:40.000205 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:40.000640 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:40.031199 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-566a9cc5-5c6e-4bc8-9509-4d81f29127c0 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/58254526-688a-4731-9604-3d634924b4b7" status: 200 len: 194 microversion: 2.1 time: 0.045005 Jun 29 10:41:40.031794 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1417/2754] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Jun 29 10:41:39 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/58254526-688a-4731-9604-3d634924b4b7 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:41.391766 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c7d4d3a-16d4-416c-97aa-bc3df73c75ba"}} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:41:41.392855 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:41.399802 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:41.400228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:41.401128 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:41.401597 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:41.663683 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2102dcf6-61fd-42b0-b091-338e22e6b06e tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "POST /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275769 Jun 29 10:41:41.669828 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1338/2755] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 10:41:41 2022] POST /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:48.167575 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:48.168572 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:48.175772 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:48.176222 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:48.177358 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:48.177797 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:48.210236 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-280d3710-e295-4314-b274-9fe2d5295c51 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046810 Jun 29 10:41:48.210852 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1418/2756] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:41:48 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:48.355666 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:48.356228 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:48.362999 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:48.363447 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:48.364238 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:48.364674 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:48.395297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-013420d7-bacc-45c0-943a-c862fa668ec7 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/58254526-688a-4731-9604-3d634924b4b7" status: 200 len: 194 microversion: 2.1 time: 0.044892 Jun 29 10:41:48.395917 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1339/2757] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Jun 29 10:41:48 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/58254526-688a-4731-9604-3d634924b4b7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:48.406060 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:48.406573 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:48.412863 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:48.413314 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:48.414077 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:48.414513 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:48.513558 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lazy-loading 'services' on Instance uuid 35a0731c-558a-4f7a-9067-c025a9980af6 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:41:48.595482 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-4e736e90-04e4-449b-aa38-05da92cf658b tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/58254526-688a-4731-9604-3d634924b4b7" status: 202 len: 0 microversion: 2.1 time: 0.193389 Jun 29 10:41:48.596129 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1419/2758] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:41:48 2022] DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/58254526-688a-4731-9604-3d634924b4b7 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:41:49.715619 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:49.716214 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:49.725613 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:49.726099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:49.727158 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:49.727810 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:49.759193 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-045a3cc2-d8fe-4cc0-bf5f-e1b34c1b3a3a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/1c7d4d3a-16d4-416c-97aa-bc3df73c75ba" status: 200 len: 194 microversion: 2.1 time: 0.047557 Jun 29 10:41:49.759820 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1340/2759] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Jun 29 10:41:49 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/1c7d4d3a-16d4-416c-97aa-bc3df73c75ba => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:49.770725 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:49.771280 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:49.778310 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:49.778916 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:49.779696 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:49.780140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:49.869405 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.objects.instance [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lazy-loading 'services' on Instance uuid 35a0731c-558a-4f7a-9067-c025a9980af6 {{(pid=117950) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 10:41:49.951250 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3b6bfea3-76e9-4b68-8f74-98f9a49bc745 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/1c7d4d3a-16d4-416c-97aa-bc3df73c75ba" status: 202 len: 0 microversion: 2.1 time: 0.184555 Jun 29 10:41:49.951994 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1420/2760] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 10:41:49 2022] DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments/1c7d4d3a-16d4-416c-97aa-bc3df73c75ba => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:41:51.130857 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:51.131850 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:51.139610 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.140053 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.140819 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.141247 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.172308 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-9b83b011-f312-4000-ad56-a55d65268b92 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045365 Jun 29 10:41:51.172867 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1341/2761] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:41:51 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 10:41:51.291947 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:51.292963 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:51.300355 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.300799 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.301561 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.302362 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.333540 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-68e77ff2-e835-4130-986d-bd76b7c2d942 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046626 Jun 29 10:41:51.334104 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1421/2762] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 10:41:51 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 10:41:51.402781 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:51.403293 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:51.410413 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.410875 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.411670 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.412085 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.439688 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Going to try to terminate instance {{(pid=117951) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 10:41:51.528808 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-2d3ea4dc-8d9b-4a33-9c21-76bebd836b58 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 204 len: 0 microversion: 2.1 time: 0.129334 Jun 29 10:41:51.529354 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1342/2763] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:41:51 2022] DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 10:41:51.539998 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:51.540613 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:51.547143 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.547601 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.548378 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:51.548818 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:51.689864 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:41:51.697774 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-3ef922da-218a-443f-a874-24cc0917c738 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1673 microversion: 2.1 time: 0.163126 Jun 29 10:41:51.698345 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1422/2764] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:41:51 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:41:52.716311 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:52.717017 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:52.724290 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:52.724747 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:52.725527 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:52.725970 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:52.875272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.policy [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117951) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:41:52.883432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-ae45baef-5644-4663-9a72-b1e79a538d98 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1673 microversion: 2.1 time: 0.171461 Jun 29 10:41:52.884010 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1343/2765] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:41:52 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:41:53.902094 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:53.903037 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:53.910460 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:53.911047 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:53.911920 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:53.914602 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:54.287473 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.policy [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '066254622cf34ca282883c1a033722a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1328f3aff9a042068380feeb1e7c5f1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117950) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 10:41:54.295534 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-585a4803-73d5-40c8-ad98-801fd8db7dc6 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 200 len: 1605 microversion: 2.1 time: 0.398433 Jun 29 10:41:54.296119 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1423/2766] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:41:53 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 1605 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 10:41:54.443432 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [req-96c04cf0-e2c3-44ec-8ef6-eb728d7a05af req-5a0dbc89-499a-4ab2-99b2-b6ec4514ad8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a0731c-558a-4f7a-9067-c025a9980af6", "name": "network-vif-deleted", "tag": "5e6a8355-3893-4c82-a047-72a518f3273c"}]} {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 10:41:54.452041 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-96c04cf0-e2c3-44ec-8ef6-eb728d7a05af req-5a0dbc89-499a-4ab2-99b2-b6ec4514ad8a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:54.452817 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [req-96c04cf0-e2c3-44ec-8ef6-eb728d7a05af req-5a0dbc89-499a-4ab2-99b2-b6ec4514ad8a service nova] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:54.465568 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.compute.server_external_events [req-96c04cf0-e2c3-44ec-8ef6-eb728d7a05af req-5a0dbc89-499a-4ab2-99b2-b6ec4514ad8a service nova] Creating event network-vif-deleted:5e6a8355-3893-4c82-a047-72a518f3273c for instance 35a0731c-558a-4f7a-9067-c025a9980af6 on hv-cinder-76810 Jun 29 10:41:54.471237 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [req-96c04cf0-e2c3-44ec-8ef6-eb728d7a05af req-5a0dbc89-499a-4ab2-99b2-b6ec4514ad8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095433 Jun 29 10:41:54.472099 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1344/2767] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 10:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 10:41:55.314873 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:55.315501 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:55.322917 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:55.323373 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:55.324164 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:55.324593 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:55.343031 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] HTTP exception thrown: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Request method failure captured: Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 HTTP/1.1 Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCuLBWT0dLf6x7aabg8fJ1EjiPo5LdGVJiAU0CjetooeFUIisw8P1vfI25_XVUW0oRJrm6nceg0CqXvYcxEZHH4CUM0F7GEMTDcj-ZIMA-14qratqvdzww_YQAHx1RerrL3xQ9N8_EG_ecVSGLHtetUp_LhEdCrFiRm0NGP2OmCQuCg Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:41:55.344802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 066254622cf34ca282883c1a033722a4 Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:55.346097 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '35a0731c-558a-4f7a-9067-c025a9980af6'} Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:41:55.346842 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:55.348050 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:55.349079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Returning 404 to user: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:41:55.349079 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-52a42abd-69f9-4566-a77d-2379ee76ce2a tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 404 len: 111 microversion: 2.1 time: 0.035461 Jun 29 10:41:55.356754 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1424/2768] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:41:55 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:41:55.361272 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-f4a59893-75cb-4c1d-ba64-1af727722492 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '.version_select at 0x7f387438bee0>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:55.383785 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-f4a59893-75cb-4c1d-ba64-1af727722492 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027707473" status: 202 len: 0 microversion: 2.1 time: 0.031375 Jun 29 10:41:55.384374 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1345/2769] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 10:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027707473 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 10:41:58.359568 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:58.360140 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:58.367189 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:58.367665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:58.368432 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:58.368850 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:58.383645 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] HTTP exception thrown: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Request method failure captured: Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 HTTP/1.1 Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCuLBWT0dLf6x7aabg8fJ1EjiPo5LdGVJiAU0CjetooeFUIisw8P1vfI25_XVUW0oRJrm6nceg0CqXvYcxEZHH4CUM0F7GEMTDcj-ZIMA-14qratqvdzww_YQAHx1RerrL3xQ9N8_EG_ecVSGLHtetUp_LhEdCrFiRm0NGP2OmCQuCg Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:41:58.385232 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 066254622cf34ca282883c1a033722a4 Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.386598 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '35a0731c-558a-4f7a-9067-c025a9980af6'} Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:41:58.387340 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.388481 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.390434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Returning 404 to user: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:41:58.390434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-53f39260-8160-435e-82fb-6b90983a15e4 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 404 len: 111 microversion: 2.1 time: 0.031231 Jun 29 10:41:58.390434 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1425/2770] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:41:58 2022] DELETE /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:41:58.399566 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:58.400740 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 35a0731c-558a-4f7a-9067-c025a9980af6] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:58.409663 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:58.410129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:58.410931 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:58.411370 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:58.428818 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] HTTP exception thrown: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Request method failure captured: Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 HTTP/1.1 Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCuLBWT0dLf6x7aabg8fJ1EjiPo5LdGVJiAU0CjetooeFUIisw8P1vfI25_XVUW0oRJrm6nceg0CqXvYcxEZHH4CUM0F7GEMTDcj-ZIMA-14qratqvdzww_YQAHx1RerrL3xQ9N8_EG_ecVSGLHtetUp_LhEdCrFiRm0NGP2OmCQuCg Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:41:58.431129 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 066254622cf34ca282883c1a033722a4 Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.432321 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '35a0731c-558a-4f7a-9067-c025a9980af6'} Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:41:58.433217 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. Jun 29 10:41:58.434457 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:58.435636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Returning 404 to user: Instance 35a0731c-558a-4f7a-9067-c025a9980af6 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:41:58.435636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-cb8553b6-2783-4422-965e-c3d99f8ddb38 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6" status: 404 len: 111 microversion: 2.1 time: 0.039791 Jun 29 10:41:58.435636 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1346/2771] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:41:58 2022] GET /compute/v2.1/servers/35a0731c-558a-4f7a-9067-c025a9980af6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:41:59.600991 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:59.601516 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.compute.api [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117950) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:59.608246 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:59.609428 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:59.610197 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:59.610665 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG oslo_concurrency.lockutils [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:59.625111 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.wsgi [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] HTTP exception thrown: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Request method failure captured: Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: request: DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 HTTP/1.1 Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept: application/json Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Accept-Encoding: identity Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Connection: close Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Length: 0 Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Content-Type: application/json Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Host: 10.222.0.52 Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Openstack-System-Scope: None Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: User-Agent: python-urllib3/1.26.9 Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Auth-Token: gAAAAABivCuLBWT0dLf6x7aabg8fJ1EjiPo5LdGVJiAU0CjetooeFUIisw8P1vfI25_XVUW0oRJrm6nceg0CqXvYcxEZHH4CUM0F7GEMTDcj-ZIMA-14qratqvdzww_YQAHx1RerrL3xQ9N8_EG_ecVSGLHtetUp_LhEdCrFiRm0NGP2OmCQuCg Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Id: None Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Domain-Name: None Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Identity-Status: Confirmed Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Is-Admin-Project: True Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Id: default Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Domain-Name: Default Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Project-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Role: member,reader Jun 29 10:41:59.626798 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Roles: member,reader Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Id: default Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Domain-Name: Default Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Id: 066254622cf34ca282883c1a033722a4 Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: X-User-Name: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: method: > Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: exception: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.628134 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: action_args: {'id': '9a603aa1-5bdb-4d1c-9557-50dade0cd4e8'} Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: {{(pid=117950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:41:59.628821 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.629987 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.631379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: DEBUG nova.api.openstack.wsgi [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Returning 404 to user: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. {{(pid=117950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:41:59.631379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO nova.api.openstack.requestlog [None req-8a2c5598-1a9b-4210-b2da-aed65d190d6c tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 404 len: 111 microversion: 2.1 time: 0.031257 Jun 29 10:41:59.631379 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: [pid: 117950|app: 0|req: 1426/2772] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 10:41:59 2022] DELETE /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:41:59.639968 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Calling method '>' {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 10:41:59.640710 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.compute.api [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] [instance: 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8] Fetching instance by UUID {{(pid=117951) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 10:41:59.647500 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:59.647959 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:59.648723 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 10:41:59.649162 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG oslo_concurrency.lockutils [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Lock "07dec559-bc61-4440-a91c-9dffeca16423" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 10:41:59.666540 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.wsgi [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] HTTP exception thrown: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Request method failure captured: Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: request: GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 HTTP/1.1 Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept: application/json Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Accept-Encoding: identity Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Connection: close Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Length: 0 Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Content-Type: application/json Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Host: 10.222.0.52 Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Openstack-System-Scope: None Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: User-Agent: python-urllib3/1.26.9 Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Auth-Token: gAAAAABivCuLBWT0dLf6x7aabg8fJ1EjiPo5LdGVJiAU0CjetooeFUIisw8P1vfI25_XVUW0oRJrm6nceg0CqXvYcxEZHH4CUM0F7GEMTDcj-ZIMA-14qratqvdzww_YQAHx1RerrL3xQ9N8_EG_ecVSGLHtetUp_LhEdCrFiRm0NGP2OmCQuCg Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Id: None Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Domain-Name: None Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Identity-Status: Confirmed Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Is-Admin-Project: True Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Id: default Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Domain-Name: Default Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Project-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Role: member,reader Jun 29 10:41:59.668213 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Roles: member,reader Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1328f3aff9a042068380feeb1e7c5f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Id: 1328f3aff9a042068380feeb1e7c5f1e Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1740461163 Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Id: default Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Domain-Name: Default Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Id: 066254622cf34ca282883c1a033722a4 Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: X-User-Name: tempest-AttachVolumeTestJSON-1740461163-project Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: method: > Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: exception: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.669789 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: action_args: {'id': '9a603aa1-5bdb-4d1c-9557-50dade0cd4e8'} Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: {{(pid=117951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 10:41:59.670839 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. Jun 29 10:41:59.672206 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: ERROR nova.api.openstack.wsgi Jun 29 10:41:59.673251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: DEBUG nova.api.openstack.wsgi [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] Returning 404 to user: Instance 9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 could not be found. {{(pid=117951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 10:41:59.673251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO nova.api.openstack.requestlog [None req-bd8c66e0-1a08-4358-9a5c-7acd3d7591f2 tempest-AttachVolumeTestJSON-1740461163 tempest-AttachVolumeTestJSON-1740461163-project] 10.222.0.52 "GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8" status: 404 len: 111 microversion: 2.1 time: 0.033977 Jun 29 10:41:59.673251 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: [pid: 117951|app: 0|req: 1347/2773] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 10:41:59 2022] GET /compute/v2.1/servers/9a603aa1-5bdb-4d1c-9557-50dade0cd4e8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 10:43:29.982126 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:43:29.982802 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:43:37.883656 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:43:37.884275 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:43:40.373399 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:43:40.374275 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:43:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:44:26.801096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:44:26.801096 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:44:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:44:56.347477 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:44:56.348362 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:46:49.992242 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:46:49.993186 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:46:57.893435 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:46:57.894297 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:47:00.383048 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:47:00.383909 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:47:23.788766 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:47:23.789906 dv-cinder-768105-16-iscsi devstack@n-api.service[117950]: Wed Jun 29 10:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 10:47:46.814899 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 10:47:46.815736 dv-cinder-768105-16-iscsi devstack@n-api.service[117951]: Wed Jun 29 10:47:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!